Cross-lingual Semantic Representation for NLP with UCCA (2020)

Abstract: This is an introductory tutorial to UCCA (Universal Conceptual Cognitive Annotation), a cross-linguistically applicable framework for semantic representation, with corpora annotated in English, German and French, and ongoing annotation in Russian and Hebrew. UCCA builds on extensive typological work and supports rapid annotation. The tutorial will provide a detailed introduction to the UCCA annotation guidelines, design philosophy and the available resources; and a comparison to other meaning representations. It will also survey the existing parsing work, including the findings of three recent shared tasks, in SemEval and CoNLL, that addressed UCCA parsing. Finally, the tutorial will present recent applications and extensions to the scheme, demonstrating its value for natural language processing in a range of languages and domains.

## introduction universal conceptual cognitive annotation @xcite , abbreviated as "ucca", is a symbolic meaning representation (mr) that supports human annotation of text with broad coverage. while several meaning representation schemes share this goal @xcite , ucca targets a level of semantic granularity that abstracts away from syntactic paraphrases in a typologicallymotivated, cross-linguistic fashion, building on basic linguistic theory @xcite , an influential framework for linguistic description. the scheme does not rely on language-specific resources, and sets a low threshold for annotator training. ucca has been annotated on several corpora of different genres and languages, foot_0 as summarized in in ucca, an analysis of a text passage is a directed acyclic graph over semantic elements called units. the principal kind of unit is a scene, which describes an action, movement or state, and is similar to framenet's notion of a frame. figure 1 contains three scenes, evoked, respectively, by the verb took, the noun phrase a repair, and the possessive our. several elements are exemplified, including participants, secondary relations, and scene linkage. the graph is anchored in the text tokens (the leaves generally correspond to one or more tokens), and relations between units are indicated by the categories assigned to the edges connecting them. the goals of this tutorial are: to describe the ucca representation as a linguistic scheme and how it is being used computationally, especially for cross-lingual and multilingual nlp; to familiarize participants with existing ucca parsers and equip them with the conceptual tools required for desigining new parsers; and to review existing extensions and possible future directions. foot_1 2 relevance ucca resources and applications are valuable for cross-lingual nlp: like universal dependencies @xcite we took our vehicle in for a repair to the air conditioning . we took our vehicle in for a repair to the air conditioning it is also cross-linguistically stable, and reflects a level of semantic structure that is usually preserved in translations @xcite . ucca has been applied in nlp to text simplification @xcite , and text-to-text generation evaluation @xcite @xcite @xcite . the tutorial will describe the guidelines and rationale behind ucca, helping potential application designers understand what abstractions it makes. significant effort has been devoted to building ucca parsers @xcite @xcite @xcite @xcite @xcite @xcite @xcite @xcite @xcite @xcite @xcite @xcite @xcite , including a semeval 2019 shared task on cross-lingual ucca parsing @xcite , which had 8 participating teams, as well as conll 2019 and conll 2020 shared tasks on cross-framework and cross-lingual meaning representation parsing @xcite , where 12 and 4 teams, respectively, submitted parsed ucca graphs. this tutorial will allow researchers interested in ucca parsing, and more generally graph parsing, deepen their understanding of the framework, and what properties make it unique. the tutorial will include a brief survey of the various approaches taken by existing parsers, and prepare attendees to work on ucca parsing themselves. furthermore, ucca parsing has been shown to benefit from multi-task learning @xcite with other meaning representations @xcite , although results from the conll 2019 and conll 2020 shared tasks @xcite show that multi-task meaning representation parsing is difficult. the tutorial will compare and contrast ucca and other meaning representations, and will thereby inform participants of the potential advantages and difficulties in employing multi-task learning across semantic schemes. ucca defines a small inventory of coarse-grained categories so as not to rely on language-specific lexical resources, and can thus in principle be applied to a great variety of languages. this distinguishes ucca from finer-grained sentence-structural representations like framenet @xcite , the abstract meaning representation @xcite , which relies on propbank @xcite , and universal decompositional semantics @xcite . for example, framenet requires a different ontology for each new language addressed @xcite @xcite @xcite , and amr underwent significant customization to be applicable to chinese @xcite . decomp takes a different approach to multilinguality, where the parser is required to parse sentences in other languages to their corresponding english semantic forms @xcite . the tutorial will address contemporary issues in the field, such as the question of how to represent semantic structure multilingually with broad coverage, which is actively being explored from many angles. while ucca structures and categories are intentionally coarse, the scheme has a multi-layered architecture, which allows for refinement using additional layers, which serve as "modules" of semantic distinctions. we will give an overview of the recently proposed extensions (to support coreference) and joint parsing experiments @xcite . ## agenda the planned division of time is as follows: ## presenters the instruction in this tutorial involves organizers at various career stages, exhibiting geographic diversity, and diversity in terms of gender. omri abend ( https://www.cse.huji.ac.il/~oabend ) is a senior lecturer (assistant professor) of computer science and cognitive science at the hebrew university of jerusalem. research interests: computational semantics and specifically, cross-linguistically applicable semantic and grammatical representation, semantic parsing, corpus annotation and evaluation. relevant experience: co-developer of the ucca scheme, partner in all annotation and application efforts related to ucca, and in some of the parsing efforts. publishes regularly in nlp conferences (acl, naacl, emnlp etc.). dotan dvir has been managing the ucca manual annotation project at the hebrew university of jerusalem since 2017. she was involved in writing version 2 of the ucca guidelines. she has in-depth knowledge of the ucca guidelines and is experienced in instructing annotators about them. before joining the ucca project, she had been working as a text analyst in ibm's project debater @xcite @xcite . daniel hershcovich ( https://danielhers.github.io ) is a tenure-track assistant professor at the university of copenhagen, denmark. daniel pioneered the work on ucca parsing, and is interested in semantic parsing and meaning representations. daniel develops and maintains the ucca toolkit python codebase, foot_2 has teaching experience in nlp and ml courses, and publishes in nlp conferences. jakob prange ( https://prange.jakob.georgetown.domains ) is pursuing his ph.d. at georgetown university, investigating design, annotation, and parsing strategies for various meaning representations. among other formalisms (snacs, frame semantics, stag, ccg), he has studied and worked with ucca over the past two years, which recently resulted in two published proposals of novel ucca extensions, for coreference and semantic roles. he has experience with teaching in multicultural classroom settings and presenting research at international conferences. nathan schneider ( http://nathan.cl ) leads an interdisciplinary computational linguistics research group at georgetown university. he has worked on the design and parsing of a range of broadcoverage representations for different aspects and granularities of meaning, including multiword expressions, supersenses, frame semantics, amr, and ucca (as a multiyear collaboration with the copresenters). he has experience teaching meaning representations in classroom settings as well as conference tutorials-notably, a tutorial on amr @xcite whose materials foot_3 continue to serve as a useful introduction to the scheme, and will serve as a model for the proposed ucca tutorial.