pwc-archive/papers-with-abstracts huggingface dataset:
Di-LSTM Contrast : A Deep Neural Network for Metaphor Detection
Authors: Krishnkant Swarnkar, Anil Kumar Singh
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: POS, Topic Models, Word Embeddings

The contrast between the contextual and general meaning of a word serves as an important clue for detecting its metaphoricity. In this paper, we present a deep neural architecture for metaphor detection which exploits this contrast. Additionally, we also use cost-sensitive learning by re-weighting examples, and baseline features like concreteness ratings, POS and WordNet-based features. The best performing system of ours achieves an overall F1 score of 0.570 on All POS category and 0.605 on the Verbs category at the Metaphor Shared Task 2018.
Conditional Random Fields for Metaphor Detection
Authors: Anna Mosolova, Ivan Bondarenko, Vadim Fomin
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Word Embeddings

We present an algorithm for detecting metaphor in sentences which was used in Shared Task on Metaphor Detection by First Workshop on Figurative Language Processing. The algorithm is based on different features and Conditional Random Fields.
Detecting Figurative Word Occurrences Using Recurrent Neural Networks
Authors: Agnieszka Mykowiecka, Aleks Wawer, er, Malgorzata Marciniak
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Word Embeddings

The paper addresses detection of figurative usage of words in English text. The chosen method was to use neural nets fed by pretrained word embeddings. The obtained results show that simple solutions, based on words embeddings only, are comparable to complex solutions, using many sources of information which are not available for languages less-studied than English.
Multi-Module Recurrent Neural Networks with Transfer Learning
Authors: Filip Skurniak, Maria Janicka, Aleks Wawer, er
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Machine Translation, Transfer Learning, Translation, Word Embeddings

This paper describes multiple solutions designed and tested for the problem of word-level metaphor detection. The proposed systems are all based on variants of recurrent neural network architectures. Specifically, we explore multiple sources of information: pre-trained word embeddings (Glove), a dictionary of language concreteness and a transfer learning scenario based on the states of an encoder network from neural network machine translation system. One of the architectures is based on combining all three systems: (1) Neural CRF (Conditional Random Fields), trained directly on the metaphor data set; (2) Neural Machine Translation encoder of a transfer learning scenario; (3) a neural network used to predict final labels, trained directly on the metaphor data set. Our results vary between test sets: Neural CRF standalone is the best one on submission data, while combined system scores the highest on a test subset randomly selected from training data.
Using Language Learner Data for Metaphor Detection
Authors: Egon Stemle, Alex Onysko, er
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Language Identification, Word Embeddings

This article describes the system that participated in the shared task on metaphor detection on the Vrije University Amsterdam Metaphor Corpus (VUA). The ST was part of the workshop on processing figurative language at the 16th annual conference of the North American Chapter of the Association for Computational Linguistics (NAACL2018). The system combines a small assertion of trending techniques, which implement matured methods from NLP and ML; in particular, the system uses word embeddings from standard corpora and from corpora representing different proficiency levels of language learners in a LSTM BiRNN architecture. The system is available under the APLv2 open-source license.
What makes us laugh? Investigations into Automatic Humor Classification
Authors: Vikram Ahuja, Taradheesh Bali, Navjyoti Singh
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Classification, General Classification, Humor Detection

Most scholarly works in the field of computational detection of humour derive their inspiration from the incongruity theory. Incongruity is an indispensable facet in drawing a line between humorous and non-humorous occurrences but is immensely inadequate in shedding light on what actually made the particular occurrence a funny one. Classical theories like Script-based Semantic Theory of Humour and General Verbal Theory of Humour try and achieve this feat to an adequate extent. In this paper we adhere to a more holistic approach towards classification of humour based on these classical theories with a few improvements and revisions. Through experiments based on our linear approach and performed on large data-sets of jokes, we are able to demonstrate the adaptability and show componentizability of our model, and that a host of classification techniques can be used to overcome the challenging problem of distinguishing between various categories and sub-categories of jokes.
Social and Emotional Correlates of Capitalization on Twitter
Authors: Sophia Chan, Alona Fyshe
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Sentiment Analysis

Social media text is replete with unusual capitalization patterns. We posit that capitalizing a token like THIS performs two expressive functions: it marks a person socially, and marks certain parts of an utterance as more salient than others. Focusing on gender and sentiment, we illustrate using a corpus of tweets that capitalization appears in more negative than positive contexts, and is used more by females compared to males. Yet we find that both genders use capitalization in a similar way when expressing sentiment.
Building an annotated dataset of app store reviews with Appraisal features in English and Spanish
Authors: Natalia Mora, Julia Lavid-L{\'o}pez
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Descriptive, General Classification

This paper describes the creation and annotation of a dataset consisting of 250 English and Spanish app store reviews from Google{'}s Play Store with Appraisal features. This is one of the most influential linguistic frameworks for the analysis of evaluation and opinion in discourse due to its insightful descriptive features. However, it has not been extensively applied in NLP in spite of its potential for the classification of the subjective content of these reviews. We describe the dataset, the annotation scheme and guidelines, the agreement studies, the annotation results and their impact on the characterisation of this genre.
Enabling Deep Learning of Emotion With First-Person Seed Expressions
Authors: Hassan Alhuzali, Muhammad Abdul-Mageed, Lyle Ungar
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Deep Learning, Emotion Recognition, Machine Translation

The computational treatment of emotion in natural language text remains relatively limited, and Arabic is no exception. This is partly due to lack of labeled data. In this work, we describe and manually validate a method for the automatic acquisition of emotion labeled data and introduce a newly developed data set for Modern Standard and Dialectal Arabic emotion detection focused at Robert Plutchik{'}s 8 basic emotion types. Using a hybrid supervision method that exploits first person emotion seeds, we show how we can acquire promising results with a deep gated recurrent neural network. Our best model reaches 70{\%} \textit{F}-score, significantly (i.e., 11{\%}, $p < 0.05$) outperforming a competitive baseline. Applying our method and data on an external dataset of 4 emotions released around the same time we finalized our work, we acquire 7{\%} absolute gain in $F$-score over a linear SVM classifier trained on gold data, thus validating our approach.
A Dataset of Hindi-English Code-Mixed Social Media Text for Hate Speech Detection
Authors: Aditya Bohra, Deepanshu Vijay, Vinay Singh, Syed Sarfaraz Akhtar, Manish Shrivastava
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: General Classification, Hate Speech Detection, Sentiment Analysis

Hate speech detection in social media texts is an important Natural language Processing task, which has several crucial applications like sentiment analysis, investigating cyberbullying and examining socio-political controversies. While relevant research has been done independently on code-mixed social media texts and hate speech detection, our work is the first attempt in detecting hate speech in Hindi-English code-mixed social media text. In this paper, we analyze the problem of hate speech detection in code-mixed texts and present a Hindi-English code-mixed dataset consisting of tweets posted online on Twitter. The tweets are annotated with the language at word level and the class they belong to (Hate Speech or Normal Speech). We also propose a supervised classification system for detecting hate speech in the text using various character level, word level, and lexicon based features.
The Social and the Neural Network: How to Make Natural Language Processing about People again
Authors: Dirk Hovy
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6

Over the years, natural language processing has increasingly focused on tasks that can be solved by statistical models, but ignored the social aspects of language. These limitations are in large part due to historically available data and the limitations of the models, but have narrowed our focus and biased the tools demographically. However, with the increased availability of data sets including socio-demographic information and more expressive (neural) models, we have the opportunity to address both issues. I argue that this combination can broaden the focus of NLP to solve a whole new range of tasks, enable us to generate novel linguistic insights, and provide fairer tools for everyone.
Observational Comparison of Geo-tagged and Randomly-drawn Tweets
Authors: Tom Lippincott, Annabelle Carrell
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6

Twitter is a ubiquitous source of micro-blog social media data, providing the academic, industrial, and public sectors real-time access to actionable information. A particularly attractive property of some tweets is *geo-tagging*, where a user account has opted-in to attaching their current location to each message. Unfortunately (from a researcher{'}s perspective) only a fraction of Twitter accounts agree to this, and these accounts are likely to have systematic diffences with the general population. This work is an exploratory study of these differences across the full range of Twitter content, and complements previous studies that focus on the English-language subset. Additionally, we compare methods for querying users by self-identified properties, finding that the constrained semantics of the {``}description{''} field provides cleaner, higher-volume results than more complex regular expressions.
Johns Hopkins or johnny-hopkins: Classifying Individuals versus Organizations on Twitter
Authors: Zach Wood-Doughty, Praateek Mahajan, Mark Dredze
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: General Classification

Twitter user accounts include a range of different user types. While many individuals use Twitter, organizations also have Twitter accounts. Identifying opinions and trends from Twitter requires the accurate differentiation of these two groups. Previous work (McCorriston et al., 2015) presented a method for determining if an account was an individual or organization based on account profile and a collection of tweets. We present a method that relies solely on the account profile, allowing for the classification of individuals versus organizations based on a single tweet. Our method obtains accuracies comparable to methods that rely on much more information by leveraging two improvements: a character-based Convolutional Neural Network, and an automatically derived labeled corpus an order of magnitude larger than the previously available dataset. We make both the dataset and the resulting tool available.
The Potential of the Computational Linguistic Analysis of Social Media for Population Studies
Authors: Letizia Mencarini
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6

The paper provides an outline of the scope for synergy between computational linguistic analysis and population stud-ies. It first reviews where population studies stand in terms of using social media data. Demographers are entering the realm of big data in force. But, this paper argues, population studies have much to gain from computational linguis-tic analysis, especially in terms of ex-plaining the drivers behind population processes. The paper gives two examples of how the method can be applied, and concludes with a fundamental caveat. Yes, computational linguistic analysis provides a possible key for integrating micro theory into any demographic analysis of social media data. But results may be of little value in as much as knowledge about fundamental sample characteristics are unknown.
Understanding the Effect of Gender and Stance in Opinion Expression in Debates on ``Abortion''
Authors: Esin Durmus, Claire Cardie
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6

In this paper, we focus on understanding linguistic differences across groups with different self-identified gender and stance in expressing opinions about ABORTION. We provide a new dataset consisting of users{'} gender, stance on ABORTION as well as the debates in ABORTION drawn from debate.org. We use the gender and stance information to identify significant linguistic differences across individuals with different gender and stance. We show the importance of considering the stance information along with the gender since we observe significant linguistic differences across individuals with different stance even within the same gender group.
Frustrated, Polite, or Formal: Quantifying Feelings and Tone in Email
Authors: Niyati Chhaya, Kushal Chawla, Tanya Goyal, Ch, Projjal a, Jaya Singh
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Emotion Recognition

Email conversations are the primary mode of communication in enterprises. The email content expresses an individual{'}s needs, requirements and intentions. Affective information in the email text can be used to get an insight into the sender{'}s mood or emotion. We present a novel approach to model human frustration in text. We identify linguistic features that influence human perception of frustration and model it as a supervised learning task. The paper provides a detailed comparison across traditional regression and word distribution-based models. We report a mean-squared error (MSE) of 0.018 against human-annotated frustration for the best performing model. The approach establishes the importance of affect features in frustration prediction for email data. We further evaluate the efficacy of the proposed feature set and model in predicting other tone or affects in text, namely formality and politeness; results demonstrate a comparable performance against the state-of-the-art baselines.
Reddit: A Gold Mine for Personality Prediction
Authors: Matej Gjurkovi{\'c}, Jan {\v{S}}najder
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Diversity, Prediction, Type prediction

Automated personality prediction from social media is gaining increasing attention in natural language processing and social sciences communities. However, due to high labeling costs and privacy issues, the few publicly available datasets are of limited size and low topic diversity. We address this problem by introducing a large-scale dataset derived from Reddit, a source so far overlooked for personality prediction. The dataset is labeled with Myers-Briggs Type Indicators (MBTI) and comes with a rich set of features for more than 9k users. We carry out a preliminary feature analysis, revealing marked differences between the MBTI dimensions and poles. Furthermore, we use the dataset to train and evaluate benchmark personality prediction models, achieving macro F1-scores between 67{\%} and 82{\%} on the individual dimensions and 82{\%} accuracy for exact or one-off accurate type prediction. These results are encouraging and comparable with the reliability of standardized tests.
Predicting Authorship and Author Traits from Keystroke Dynamics
Authors: Barbara Plank
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Attribute, Machine Translation

Written text transmits a good deal of nonverbal information related to the author{'}s identity and social factors, such as age, gender and personality. However, it is less known to what extent behavioral biometric traces transmit such information. We use typist data to study the predictiveness of authorship, and present first experiments on predicting both age and gender from keystroke dynamics. Our results show that the model based on keystroke features, while being two orders of magnitude smaller, leads to significantly higher accuracies for authorship than the text-based system. For user attribute prediction, the best approach is to combine the two, suggesting that extralinguistic factors are disclosed to a larger degree in written text, while author identity is better transmitted in typing behavior.
Predicting Twitter User Demographics from Names Alone
Authors: Zach Wood-Doughty, Nicholas Andrews, Rebecca Marvin, Mark Dredze
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6

Social media analysis frequently requires tools that can automatically infer demographics to contextualize trends. These tools often require hundreds of user-authored messages for each user, which may be prohibitive to obtain when analyzing millions of users. We explore character-level neural models that learn a representation of a user{'}s name and screen name to predict gender and ethnicity, allowing for demographic inference with minimal data. We release trained models1 which may enable new demographic analyses that would otherwise require enormous amounts of data collection
Modeling Personality Traits of Filipino Twitter Users
Authors: Edward Tighe, Charibeth Cheng
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: General Classification

Recent studies in the field of text-based personality recognition experiment with different languages, feature extraction techniques, and machine learning algorithms to create better and more accurate models; however, little focus is placed on exploring the language use of a group of individuals defined by nationality. Individuals of the same nationality share certain practices and communicate certain ideas that can become embedded into their natural language. Many nationals are also not limited to speaking just one language, such as how Filipinos speak Filipino and English, the two national languages of the Philippines. The addition of several regional/indigenous languages, along with the commonness of code-switching, allow for a Filipino to have a rich vocabulary. This presents an opportunity to create a text-based personality model based on how Filipinos speak, regardless of the language they use. To do so, data was collected from 250 Filipino Twitter users. Different combinations of data processing techniques were experimented upon to create personality models for each of the Big Five. The results for both regression and classification show that Conscientiousness is consistently the easiest trait to model, followed by Extraversion. Classification models for Agreeableness and Neuroticism had subpar performances, but performed better than those of Openness. An analysis on personality trait score representation showed that classifying extreme outliers generally produce better results for all traits except for Neuroticism and Openness.
Morphological Word Embeddings for Arabic Neural Machine Translation in Low-Resource Settings
Authors: Pamela Shapiro, Kevin Duh
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Low Resource NMT, Machine Translation, NMT, Translation, Word Embeddings, Word Similarity

Neural machine translation has achieved impressive results in the last few years, but its success has been limited to settings with large amounts of parallel data. One way to improve NMT for lower-resource settings is to initialize a word-based NMT model with pretrained word embeddings. However, rare words still suffer from lower quality word embeddings when trained with standard word-level objectives. We introduce word embeddings that utilize morphological resources, and compare to purely unsupervised alternatives. We work with Arabic, a morphologically rich language with available linguistic resources, and perform Ar-to-En MT experiments on a small corpus of TED subtitles. We find that word embeddings utilizing subword information consistently outperform standard word embeddings on a word similarity task and as initialization of the source word embeddings in a low-resource NMT system.
Entropy-Based Subword Mining with an Application to Word Embeddings
Authors: Ahmed El-Kishky, Frank Xu, Aston Zhang, Stephen Macke, Jiawei Han
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Language Modeling, Language Modelling, Machine Translation, Sentiment Analysis, Text Classification, Word Embeddings

Recent literature has shown a wide variety of benefits to mapping traditional one-hot representations of words and phrases to lower-dimensional real-valued vectors known as word embeddings. Traditionally, most word embedding algorithms treat each word as the finest meaningful semantic granularity and perform embedding by learning distinct embedding vectors for each word. Contrary to this line of thought, technical domains such as scientific and medical literature compose words from subword structures such as prefixes, suffixes, and root-words as well as compound words. Treating individual words as the finest-granularity unit discards meaningful shared semantic structure between words sharing substructures. This not only leads to poor embeddings for text corpora that have long-tail distributions, but also heuristic methods for handling out-of-vocabulary words. In this paper we propose SubwordMine, an entropy-based subword mining algorithm that is fast, unsupervised, and fully data-driven. We show that this allows for great cross-domain performance in identifying semantically meaningful subwords. We then investigate utilizing the mined subwords within the FastText embedding model and compare performance of the learned representations in a downstream language modeling task.
A Comparison of Character Neural Language Model and Bootstrapping for Language Identification in Multilingual Noisy Texts
Authors: Wafia Adouane, Simon Dobnik, Jean-Philippe Bernardy, Nasredine Semmar
Date: 2018-06-01 00:00:00
Proceeding: WS 2018 6
Tasks: Language Identification, Language Modeling, Language Modelling, Multi-Task Learning

This paper seeks to examine the effect of including background knowledge in the form of character pre-trained neural language model (LM), and data bootstrapping to overcome the problem of unbalanced limited resources. As a test, we explore the task of language identification in mixed-language short non-edited texts with an under-resourced language, namely the case of Algerian Arabic for which both labelled and unlabelled data are limited. We compare the performance of two traditional machine learning methods and a deep neural networks (DNNs) model. The results show that overall DNNs perform better on labelled data for the majority categories and struggle with the minority ones. While the effect of the untokenised and unlabelled data encoded as LM differs for each category, bootstrapping, however, improves the performance of all systems and all categories. These methods are language independent and could be generalised to other under-resourced languages for which a small labelled data and a larger unlabelled data are available.