DOI: 10.5281/zenodo.3365288
title: Lexicon of English Verbal Polarity Shifters

description: We provide a complete lexicon of English verbal polarity shifters and their shifting scope. Our lexicon covers all verbs of WordNet v3.1 that are single word or particle verbs. Polarity shifter and scope labels are given for each lemma-synset pair (i.e. each word sense of a lemma). <strong>Data</strong> The data is presented in the following forms: A complete lexicon of all verbal shifters and their shifting scopes. Two auxiliary lists: A list of all lemmas with shifter labels A list of all word senses with shifter labels All files are in CSV (comma-separated value) format. <strong>1. Main Lexicon</strong> File name: <code>shifter_lexicon.csv</code> The main lexicon lists all verbal shifters and their shifting scopes. Verbal shifters are modelled as lemma-sense pairs with one or more shifting scopes. Each line of the lexicon file contains a single lemma-sense-scope triple, using the format: <pre><code>LEMMA,SYNSET,SCOPE </code></pre> The elements are defined as follows: <strong>LEMMA:</strong> The lemma form of the verb. <strong>SYNSET:</strong> The numeric identifier of the synset, commonly referred to as <em>offset</em> or <em>database location</em>. It consists of 8 digits, including leading zeroes (e.g. 00334568). <strong>SCOPE:</strong> The scope of the shifting: <code>subj</code>: The verbal shifter affects its subject. <code>dobj</code>: The verbal shifter affects its direct object. <code>pobj_*</code>: The verbal shifter affects objects within a prepositional phrase. The preposition in question is included in the annotation. For example a <em>from</em>-preposition scope receives the label <code>pobj_from</code> and a a <em>for</em>-preposition receives <code>pobj_for</code>. <code>comp</code>: The verbal shifter affects a clausal complement, such as infinitive clauses or gerunds. The lexicon lists all lemma-sense pairs that are verbal shifters. Any lemma-sense pair not listed is not a verbal shifter. When a lemma-sense pair has more than one possible scope, a separate entry is made for each scope. <strong>2. Auxiliary Lists</strong> The auxiliary files represent the same shifter information as the main lexicon, but for lemmas and synsets, respectively, instead of for lemma-sense pairs. Due to their nature, these lists are more coarse-grained than the main lexicon and contain no information on shifter scope. They are provided as a convenience for fast experimentation. <strong>2.1. List of Lemmas</strong> File name: <code>shifter_lemma_lexicon.csv</code> List of all verb lemmas and whether they are shifters in at least one of their word senses. <pre><code>LEMMA,LABEL </code></pre> <strong>LEMMA:</strong> The lemma form of the verb. <strong>LABEL:</strong> <code>shifter</code> if the verb is a shifter in at least one of its word senses, otherwise <code>nonshifter</code>. Many verbal shifter lemmas only cause shifting in some of their word senses. This list is therefore considerably more coarse-grained than the main lexicon. <strong>2.2. List of Synsets</strong> File name: <code>shifter_synset_lexicon.csv</code> List of all synsets and whether their lemmas are shifters in this specific word sense. <pre><code>SYNSET,LABEL </code></pre> <strong>SYNSET:</strong> The numeric identifier of the synset, commonly referred to as <em>offset</em> or <em>database location</em>. It consists of 8 digits, including leading zeroes (e.g. 00334568). <strong>LABEL:</strong> <code>shifter</code> if the word sense causes shifting, otherwise <code>nonshifter</code>. Shifting is shared among lemmas of the same word sense. This list, therefore, provides (almost) the same granularity for the shifter label as the main lexicon. However, in a few exceptions, synsets contained words with subtly different senses that did not all cause shifting. These senses are considered shifters in this list, analogous to the generalisation in the list of lemmas. <strong>Attribution</strong> This dataset was created as part of the following publication: Schulder, Marc and Wiegand, Michael and Ruppenhofer, Josef and Köser, Stephanie (2018). <strong>"Introducing a Lexicon of Verbal Polarity Shifters for English"</strong>. Proceedings of the 11th Conference on Language Resources and Evaluation (LREC). Miyazaki, Japan, May 7-12, 2018. DOI: 10.5281/zenodo.3365683. If you use the data in your research or work, please cite the publication.
description: This work was partially supported by the German Research Foundation (DFG) under grants RU 1873/2-1 and WI4204/2-1.