pwc-archive/papers-with-abstracts huggingface dataset:
Multi-source synthetic treebank creation for improved cross-lingual dependency parsing
Authors: Francis Tyers, Mariya Sheyanova, Aleks Martynova, ra, Pavel Stepachev, Konstantin Vinogorodskiy
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Dependency Parsing, Machine Translation, Sentence, Translation

This paper describes a method of creating synthetic treebanks for cross-lingual dependency parsing using a combination of machine translation (including pivot translation), annotation projection and the spanning tree algorithm. Sentences are first automatically translated from a lesser-resourced language to a number of related highly-resourced languages, parsed and then the annotations are projected back to the lesser-resourced language, leading to multiple trees for each sentence from the lesser-resourced language. The final treebank is created by merging the possible trees into a graph and running the spanning tree algorithm to vote for the best tree for each sentence. We present experiments aimed at parsing Faroese using a combination of Danish, Swedish and Norwegian. In a similar experimental setup to the CoNLL 2018 shared task on dependency parsing we report state-of-the-art results on dependency parsing for Faroese using an off-the-shelf parser.
Toward Universal Dependencies for Shipibo-Konibo
Authors: Alonso Vasquez, Renzo Ego Aguirre, C Angulo, y, John Miller, Claudia Villanueva, {\v{Z}}eljko Agi{\'c}, Roberto Zariquiey, Arturo Oncevay
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Dependency Parsing, Machine Translation

We present an initial version of the Universal Dependencies (UD) treebank for Shipibo-Konibo, the first South American, Amazonian, Panoan and Peruvian language with a resource built under UD. We describe the linguistic aspects of how the tagset was defined and the treebank was annotated; in addition we present our specific treatment of linguistic units called \textit{clitics}. Although the treebank is still under development, it allowed us to perform a typological comparison against Spanish, the predominant language in Peru, and dependency syntax parsing experiments in both monolingual and cross-lingual approaches.
Extended and Enhanced Polish Dependency Bank in Universal Dependencies Format
Authors: Alina Wr{\'o}blewska
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: 8k, Dependency Parsing

The paper presents the largest Polish Dependency Bank in Universal Dependencies format {--} PDBUD {--} with 22K trees and 352K tokens. PDBUD builds on its previous version, i.e. the Polish UD treebank (PL-SZ), and contains all 8K PL-SZ trees. The PL-SZ trees are checked and possibly corrected in the current edition of PDBUD. Further 14K trees are automatically converted from a new version of Polish Dependency Bank. The PDBUD trees are expanded with the enhanced edges encoding the shared dependents and the shared governors of the coordinated conjuncts and with the semantic roles of some dependents. The conducted evaluation experiments show that PDBUD is large enough for training a high-quality graph-based dependency parser for Polish.
Approximate Dynamic Oracle for Dependency Parsing with Reinforcement Learning
Authors: Xiang Yu, Ngoc Thang Vu, Jonas Kuhn
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Dependency Parsing, Imitation Learning, Q-Learning, reinforcement-learning, Reinforcement Learning, Reinforcement Learning (RL), Structured Prediction

We present a general approach with reinforcement learning (RL) to approximate dynamic oracles for transition systems where exact dynamic oracles are difficult to derive. We treat oracle parsing as a reinforcement learning problem, design the reward function inspired by the classical dynamic oracle, and use Deep Q-Learning (DQN) techniques to train the oracle with gold trees as features. The combination of a priori knowledge and data-driven methods enables an efficient dynamic oracle, which improves the parser performance over static oracles in several transition systems.
The Coptic Universal Dependency Treebank
Authors: Amir Zeldes, Mitchell Abrams
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11

This paper presents the Coptic Universal Dependency Treebank, the first dependency treebank within the Egyptian subfamily of the Afro-Asiatic languages. We discuss the composition of the corpus, challenges in adapting the UD annotation scheme to existing conventions for annotating Coptic, and evaluate inter-annotator agreement on UD annotation for the language. Some specific constructions are taken as a starting point for discussing several more general UD annotation guidelines, in particular for appositions, ambiguous passivization, incorporation and object-doubling.
Inducing a lexicon of sociolinguistic variables from code-mixed text
Authors: Philippa Shoemark, James Kirby, Sharon Goldwater
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11

Sociolinguistics is often concerned with how variants of a linguistic item (e.g., \textit{nothing} vs. \textit{nothin{'}}) are used by different groups or in different situations. We introduce the task of inducing lexical variables from code-mixed text: that is, identifying equivalence pairs such as (\textit{football}, \textit{fitba}) along with their linguistic code (\textit{football}→British, \textit{fitba}→Scottish). We adapt a framework for identifying gender-biased word pairs to this new task, and present results on three different pairs of English dialects, using tweets as the code-mixed text. Our system achieves precision of over 70{\%} for two of these three datasets, and produces useful results even without extensive parameter tuning. Our success in adapting this framework from gender to language variety suggests that it could be used to discover other types of analogous pairs as well.
Twitter Geolocation using Knowledge-Based Methods
Authors: Taro Miyazaki, Afshin Rahimi, Trevor Cohn, Timothy Baldwin
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Entity Linking, Graph Embedding, Stock Market Prediction

Automatic geolocation of microblog posts from their text content is particularly difficult because many location-indicative terms are rare terms, notably entity names such as locations, people or local organisations. Their low frequency means that key terms observed in testing are often unseen in training, such that standard classifiers are unable to learn weights for them. We propose a method for reasoning over such terms using a knowledge base, through exploiting their relations with other entities. Our technique uses a graph embedding over the knowledge base, which we couple with a text representation to learn a geolocation classifier, trained end-to-end. We show that our method improves over purely text-based methods, which we ascribe to more robust treatment of low-count and out-of-vocabulary entities.
Assigning people to tasks identified in email: The EPA dataset for addressee tagging for detected task intent
Authors: Revanth Rameshkumar, Peter Bailey, Abhishek Jha, Chris Quirk
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11

We describe the Enron People Assignment (EPA) dataset, in which tasks that are described in emails are associated with the person(s) responsible for carrying out these tasks. We identify tasks and the responsible people in the Enron email dataset. We define evaluation methods for this challenge and report scores for our model and na{\"\i}ve baselines. The resulting model enables a user experience operating within a commercial email service: given a person and a task, it determines if the person should be notified of the task.
A POS Tagging Model Adapted to Learner English
Authors: Ryo Nagata, Tomoya Mizumoto, Yuta Kikuchi, Yoshifumi Kawasaki, Kotaro Funakoshi
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Grammatical Error Correction, model, Part-Of-Speech Tagging, POS, POS Tagging

There has been very limited work on the adaptation of Part-Of-Speech (POS) tagging to learner English despite the fact that POS tagging is widely used in related tasks. In this paper, we explore how we can adapt POS tagging to learner English efficiently and effectively. Based on the discussion of possible causes of POS tagging errors in learner English, we show that deep neural models are particularly suitable for this. Considering the previous findings and the discussion, we introduce the design of our model based on bidirectional Long Short-Term Memory. In addition, we describe how to adapt it to a wide variety of native languages (potentially, hundreds of them). In the evaluation section, we empirically show that it is effective for POS tagging in learner English, achieving an accuracy of 0.964, which significantly outperforms the state-of-the-art POS-tagger. We further investigate the tagging results in detail, revealing which part of the model design does or does not improve the performance.
Normalization of Transliterated Words in Code-Mixed Data Using Seq2Seq Model \& Levenshtein Distance
Authors: M, Soumil al, Karthick Nanmaran
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Opinion Mining, Transliteration, Word Embeddings

Building tools for code-mixed data is rapidly gaining popularity in the NLP research community as such data is exponentially rising on social media. Working with code-mixed data contains several challenges, especially due to grammatical inconsistencies and spelling variations in addition to all the previous known challenges for social media scenarios. In this article, we present a novel architecture focusing on normalizing phonetic typing variations, which is commonly seen in code-mixed data. One of the main features of our architecture is that in addition to normalizing, it can also be utilized for back-transliteration and word identification in some cases. Our model achieved an accuracy of 90.27{\%} on the test data.
Robust Word Vectors: Context-Informed Embeddings for Noisy Texts
Authors: Valentin Malykh, Varvara Logacheva, Taras Khakhulin
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Morphological Analysis, Word Embeddings

We suggest a new language-independent architecture of robust word vectors (RoVe). It is designed to alleviate the issue of typos, which are common in almost any user-generated content, and hinder automatic text processing. Our model is morphologically motivated, which allows it to deal with unseen word forms in morphologically rich languages. We present the results on a number of Natural Language Processing (NLP) tasks and languages for the variety of related architectures and show that proposed architecture is typo-proof.
Distantly Supervised Attribute Detection from Reviews
Authors: Lisheng Fu, Pablo Barrio
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Attribute, Entity Extraction using GAN, Sentiment Analysis

This work aims to detect specific attributes of a place (e.g., if it has a romantic atmosphere, or if it offers outdoor seating) from its user reviews via distant supervision: without direct annotation of the review text, we use the crowdsourced attribute labels of the place as labels of the review text. We then use review-level attention to pay more attention to those reviews related to the attributes. The experimental results show that our attention-based model predicts attributes for places from reviews with over 98{\%} accuracy. The attention weights assigned to each review provide explanation of capturing relevant reviews.
Using Wikipedia Edits in Low Resource Grammatical Error Correction
Authors: Adriane Boyd
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Decoder, Grammatical Error Correction, Machine Translation

We develop a grammatical error correction (GEC) system for German using a small gold GEC corpus augmented with edits extracted from Wikipedia revision history. We extend the automatic error annotation tool ERRANT (Bryant et al., 2017) for German and use it to analyze both gold GEC corrections and Wikipedia edits (Grundkiewicz and Junczys-Dowmunt, 2014) in order to select as additional training data Wikipedia edits containing grammatical corrections similar to those in the gold corpus. Using a multilayer convolutional encoder-decoder neural network GEC approach (Chollampatt and Ng, 2018), we evaluate the contribution of Wikipedia edits and find that carefully selected Wikipedia edits increase performance by over 5{\%}.
Detecting Code-Switching between Turkish-English Language Pair
Authors: Zeynep Yirmibe{\c{s}}o{\u{g}}lu, G{\"u}l{\c{s}}en Eryi{\u{g}}it
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Information Retrieval

Code-switching (usage of different languages within a single conversation context in an alternative manner) is a highly increasing phenomenon in social media and colloquial usage which poses different challenges for natural language processing. This paper introduces the first study for the detection of Turkish-English code-switching and also a small test data collected from social media in order to smooth the way for further studies. The proposed system using character level n-grams and conditional random fields (CRFs) obtains 95.6{\%} micro-averaged F1-score on the introduced test data set.
Modeling Student Response Times: Towards Efficient One-on-one Tutoring Dialogues
Authors: Luciana Benotti, Jayadev Bhaskaran, Sigtryggur Kjartansson, David Lang
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Math

In this paper we investigate the task of modeling how long it would take a student to respond to a tutor question during a tutoring dialogue. Solving such a task has applications in educational settings such as intelligent tutoring systems, as well as in platforms that help busy human tutors to keep students engaged. Knowing how long it would normally take a student to respond to different types of questions could help tutors optimize their own time while answering multiple dialogues concurrently, as well as deciding when to prompt a student again. We study this problem using data from a service that offers tutor support for math, chemistry and physics through an instant messaging platform. We create a dataset of 240K questions. We explore several strong baselines for this task and compare them with human performance.
Content Extraction and Lexical Analysis from Customer-Agent Interactions
Authors: Sergiu Nisioi, Anca Bucur, Liviu P. Dinu
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: ERP, Lexical Analysis

In this paper, we provide a lexical comparative analysis of the vocabulary used by customers and agents in an Enterprise Resource Planning (ERP) environment and a potential solution to clean the data and extract relevant content for NLP. As a result, we demonstrate that the actual vocabulary for the language that prevails in the ERP conversations is highly divergent from the standardized dictionary and further different from general language usage as extracted from the Common Crawl corpus. Moreover, in specific business communication circumstances, where it is expected to observe a high usage of standardized language, code switching and non-standard expression are predominant, emphasizing once more the discrepancy between the day-to-day use of language and the standardized one.
Preferred Answer Selection in Stack Overflow: Better Text Representations ... and Metadata, Metadata, Metadata
Authors: Steven Xu, Andrew Bennett, Doris Hoogeveen, Jey Han Lau, Timothy Baldwin
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Answer Selection, Community Question Answering, Information Retrieval, Question Answering, Retrieval

Community question answering (cQA) forums provide a rich source of data for facilitating non-factoid question answering over many technical domains. Given this, there is considerable interest in answer retrieval from these kinds of forums. However this is a difficult task as the structure of these forums is very rich, and both metadata and text features are important for successful retrieval. While there has recently been a lot of work on solving this problem using deep learning models applied to question/answer text, this work has not looked at how to make use of the rich metadata available in cQA forums. We propose an attention-based model which achieves state-of-the-art results for text-based answer selection alone, and by making use of complementary meta-data, achieves a substantially higher result over two reference datasets novel to this work.
Word-like character n-gram embedding
Authors: Geewook Kim, Kazuki Fukui, Hidetoshi Shimodaira
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Segmentation, Word Embeddings

We propose a new word embedding method called \textit{word-like character} n\textit{-gram embedding}, which learns distributed representations of words by embedding word-like character n-grams. Our method is an extension of recently proposed \textit{segmentation-free word embedding}, which directly embeds frequent character n-grams from a raw corpus. However, its n-gram vocabulary tends to contain too many non-word n-grams. We solved this problem by introducing an idea of \textit{expected word frequency}. Compared to the previously proposed methods, our method can embed more words, along with the words that are not included in a given basic word dictionary. Since our method does not rely on word segmentation with rich word dictionaries, it is especially effective when the text in the corpus is in unsegmented language and contains many neologisms and informal words (e.g., Chinese SNS dataset). Our experimental results on Sina Weibo (a Chinese microblog service) and Twitter show that the proposed method can embed more words and improve the performance of downstream tasks.
Classification of Tweets about Reported Events using Neural Networks
Authors: Kiminobu Makino, Yuka Takei, Taro Miyazaki, Jun Goto
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Classification, General Classification

We developed a system that automatically extracts {``}Event-describing Tweets{''} which include incidents or accidents information for creating news reports. Event-describing Tweets can be classified into {``}Reported-event Tweets{''} and {``}New-information Tweets.{''} Reported-event Tweets cite news agencies or user generated content sites, and New-information Tweets are other Event-describing Tweets. A system is needed to classify them so that creators of factual TV programs can use them in their productions. Proposing this Tweet classification task is one of the contributions of this paper, because no prior papers have used the same task even though program creators and other events information collectors have to do it to extract required information from social networking sites. To classify Tweets in this task, this paper proposes a method to input and concatenate character and word sequences in Japanese Tweets by using convolutional neural networks. This proposed method is another contribution of this paper. For comparison, character or word input methods and other neural networks are also used. Results show that a system using the proposed method and architectures can classify Tweets with an F1 score of 88 {\%}.
Learning to Define Terms in the Software Domain
Authors: Balach, Vidhisha ran, Dheeraj Rajagopal, Rose Catherine Kanjirathinkal, William Cohen
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Knowledge Base Population, Language Modeling, Language Modelling, Relationship Extraction (Distant Supervised)

One way to test a person{'}s knowledge of a domain is to ask them to define domain-specific terms. Here, we investigate the task of automatically generating definitions of technical terms by reading text from the technical domain. Specifically, we learn definitions of software entities from a large corpus built from the user forum Stack Overflow. To model definitions, we train a language model and incorporate additional domain-specific information like word co-occurrence, and ontological category information. Our approach improves previous baselines by 2 BLEU points for the definition generation task. Our experiments also show the additional challenges associated with the task and the short-comings of language-model based architectures for definition generation.
FrameIt: Ontology Discovery for Noisy User-Generated Text
Authors: Dan Iter, Alon Halevy, Wang-Chiew Tan
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Active Learning, Semantic Role Labeling

A common need of NLP applications is to extract structured data from text corpora in order to perform analytics or trigger an appropriate action. The ontology defining the structure is typically application dependent and in many cases it is not known a priori. We describe the FrameIt System that provides a workflow for (1) quickly discovering an ontology to model a text corpus and (2) learning an SRL model that extracts the instances of the ontology from sentences in the corpus. FrameIt exploits data that is obtained in the ontology discovery phase as weak supervision data to bootstrap the SRL model and then enables the user to refine the model with active learning. We present empirical results and qualitative analysis of the performance of FrameIt on three corpora of noisy user-generated text.
Using Author Embeddings to Improve Tweet Stance Classification
Authors: Adrian Benton, Mark Dredze
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Classification, General Classification, Stance Classification

Many social media classification tasks analyze the content of a message, but do not consider the context of the message. For example, in tweet stance classification {--} where a tweet is categorized according to a viewpoint it espouses {--} the expressed viewpoint depends on latent beliefs held by the user. In this paper we investigate whether incorporating knowledge about the author can improve tweet stance classification. Furthermore, since author information and embeddings are often unavailable for labeled training examples, we propose a semi-supervised pretraining method to predict user embeddings. Although the neural stance classifiers we learn are often outperformed by a baseline SVM, author embedding pre-training yields improvements over a non-pre-trained neural network on four out of five domains in the SemEval 2016 6A tweet stance classification task. In a tweet gun control stance classification dataset, improvements from pre-training are only apparent when training data is limited.
Low-resource named entity recognition via multi-source projection: Not quite there yet?
Authors: Jan Vium Enghoff, S{\o}ren Harrison, {\v{Z}}eljko Agi{\'c}
Date: 2018-11-01 00:00:00
Proceeding: WS 2018 11
Tasks: Cross-Lingual Transfer, Dependency Parsing, Low Resource Named Entity Recognition, named-entity-recognition, Named Entity Recognition, Named Entity Recognition (NER), Part-Of-Speech Tagging, Transfer Learning

Projecting linguistic annotations through word alignments is one of the most prevalent approaches to cross-lingual transfer learning. Conventional wisdom suggests that annotation projection {``}just works{''} regardless of the task at hand. We carefully consider multi-source projection for named entity recognition. Our experiment with 17 languages shows that to detect named entities in true low-resource languages, annotation projection may not be the right way to move forward. On a more positive note, we also uncover the conditions that do favor named entity projection from multiple sources. We argue these are infeasible under noisy low-resource constraints.