pwc-archive/papers-with-abstracts huggingface dataset:
Improving Classification of Twitter Behavior During Hurricane Events
Authors: Kevin Stowe, Jennings Anderson, Martha Palmer, Leysia Palen, Ken Anderson
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: BIG-bench Machine Learning, Classification, General Classification

A large amount of social media data is generated during natural disasters, and identifying the relevant portions of this data is critical for researchers attempting to understand human behavior, the effects of information sources, and preparatory actions undertaken during these events. In order to classify human behavior during hazard events, we employ machine learning for two tasks: identifying hurricane related tweets and classifying user evacuation behavior during hurricanes. We show that feature-based and deep learning methods provide different benefits for tweet classification, and ensemble-based methods using linguistic, temporal, and geospatial features can effectively classify user behavior.
Political discourse classification in social networks using context sensitive convolutional neural networks
Authors: Aritz Bilbao-Jayo, Aitor Almeida
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: General Classification

In this study we propose a new approach to analyse the political discourse in on-line social networks such as Twitter. To do so, we have built a discourse classifier using Convolutional Neural Networks. Our model has been trained using election manifestos annotated manually by political scientists following the Regional Manifestos Project (RMP) methodology. In total, it has been trained with more than 88,000 sentences extracted from more that 100 annotated manifestos. Our approach takes into account the context of the phrase in order to classify it, like what was previously said and the political affiliation of the transmitter. To improve the classification results we have used a simplified political message taxonomy developed within the Electronic Regional Manifestos Project (E-RMP). Using this taxonomy, we have validated our approach analysing the Twitter activity of the main Spanish political parties during 2015 and 2016 Spanish general election and providing a study of their discourse.
BinLin: A Simple Method of Dependency Tree Linearization
Authors: Yevgeniy Puzikov, Iryna Gurevych
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Text Generation

Surface Realization Shared Task 2018 is a workshop on generating sentences from lemmatized sets of dependency triples. This paper describes the results of our participation in the challenge. We develop a data-driven pipeline system which first orders the lemmas and then conjugates the words to finish the surface realization process. Our contribution is a novel sequential method of ordering lemmas, which, despite its simplicity, achieves promising results. We demonstrate the effectiveness of the proposed approach, describe its limitations and outline ways to improve it.
Surface Realization Shared Task 2018 (SR18): The Tilburg University Approach
Authors: Thiago Castro Ferreira, S Wubben, er, Emiel Krahmer
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Machine Translation, Translation

This study describes the approach developed by the Tilburg University team to the shallow task of the Multilingual Surface Realization Shared Task 2018 (SR18). Based on (Castro Ferreira et al., 2017), the approach works by first preprocessing an input dependency tree into an ordered linearized string, which is then realized using a statistical machine translation model. Our approach shows promising results, with BLEU scores above 50 for 5 different languages (English, French, Italian, Portuguese and Spanish) and above 35 for the Dutch language.
The OSU Realizer for SRST `18: Neural Sequence-to-Sequence Inflection and Incremental Locality-Based Linearization
Authors: David King, Michael White
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Language Modeling, Language Modelling, Morphological Inflection

Surface realization is a nontrivial task as it involves taking structured data and producing grammatically and semantically correct utterances. Many competing grammar-based and statistical models for realization still struggle with relatively simple sentences. For our submission to the 2018 Surface Realization Shared Task, we tackle the shallow task by first generating inflected wordforms with a neural sequence-to-sequence model before incrementally linearizing them. For linearization, we use a global linear model trained using early update that makes use of features that take into account the dependency structure and dependency locality. Using this pipeline sufficed to produce surprisingly strong results in the shared task. In future work, we intend to pursue joint approaches to linearization and morphological inflection and incorporating a neural language model into the linearization choices.
AX Semantics' Submission to the Surface Realization Shared Task 2018
Authors: Andreas Madsack, Johanna Heininger, Nyamsuren Davaasambuu, Vitaliia Voronik, Michael K{\"a}ufl, Robert Wei{\ss}graeber
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Machine Translation, Sentence

In this paper we describe our system and experimental results on the development set of the Surface Realisation Shared Task. Our system is an entry for the Shallow-Task, with two different models based on deep-learning implementations for building the sentence combined with a rule-based morphology component.
NILC-SWORNEMO at the Surface Realization Shared Task: Exploring Syntax-Based Word Ordering using Neural Models
Authors: Marco Antonio Sobrevilla Cabezudo, Thiago Pardo
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Language Modeling, Language Modelling, LEMMA, Sentence, Text Generation

This paper describes the submission by the NILC Computational Linguistics research group of the University of S{\~a}o Paulo/Brazil to the Track 1 of the Surface Realization Shared Task (SRST Track 1). We present a neural-based method that works at the syntactic level to order the words (which we refer by NILC-SWORNEMO, standing for {``}Syntax-based Word ORdering using NEural MOdels{''}). Additionally, we apply a bottom-up approach to build the sentence and, using language-specific lexicons, we produce the proper word form of each lemma in the sentence. The results obtained by our method outperformed the average of the results for English, Portuguese and Spanish in the track.
The DipInfo-UniTo system for SRST 2018
Authors: Valerio Basile, Aless Mazzei, ro
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Morphological Inflection, Text Generation

This paper describes the system developed by the DipInfo-UniTo team to participate to the shallow track of the Surface Realization Shared Task 2018. The system employs two separate neural networks with different architectures to predict the word ordering and the morphological inflection independently from each other. The UniTO realizer is language independent, and its simple architecture allowed it to be scored in the central part of the final ranking of the shared task.
Generating Questions for Reading Comprehension using Coherence Relations
Authors: Takshak Desai, Parag Dakle, Dan Moldovan
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Reading Comprehension

In this paper, we have proposed a technique for generating complex reading comprehension questions from a discourse that are more useful than factual ones derived from assertions. Our system produces a set of general-level questions using coherence relations and a set of well-defined syntactic transformations on the input text. Generated questions evaluate comprehension abilities like a comprehensive analysis of the text and its structure, correct identification of the author{'}s intent, a thorough evaluation of stated arguments; and a deduction of the high-level semantic relations that hold between text spans. Experiments performed on the RST-DT corpus allow us to conclude that our system possesses a strong aptitude for generating intricate questions. These questions are capable of effectively assessing a student{'}s interpretation of the text.
Syntactic and Lexical Approaches to Reading Comprehension
Authors: Henry Lin
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Reading Comprehension

Among the challenges of teaching reading comprehension in K {--} 12 are identifying the portions of a text that are difficult for a student, comprehending major critical ideas, and understanding context-dependent polysemous words. We present a simple, unsupervised but robust and accurate syntactic method for achieving the first objective and a modified hierarchical lexical method for the second objective. Focusing on pinpointing troublesome sentences instead of the overall readability and on concepts central to a reading, we believe these methods will greatly facilitate efforts to help students improve reading skills
Feature Optimization for Predicting Readability of Arabic L1 and L2
Authors: Hind Saddiki, Nizar Habash, Violetta Cavalli-Sforza, Muhamed Al Khalil
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Language Modeling, Language Modelling

Advances in automatic readability assessment can impact the way people consume information in a number of domains. Arabic, being a low-resource and morphologically complex language, presents numerous challenges to the task of automatic readability assessment. In this paper, we present the largest and most in-depth computational readability study for Arabic to date. We study a large set of features with varying depths, from shallow words to syntactic trees, for both L1 and L2 readability tasks. Our best L1 readability accuracy result is 94.8{\%} (75{\%} error reduction from a commonly used baseline). The comparable results for L2 are 72.4{\%} (45{\%} error reduction). We also demonstrate the added value of leveraging L1 features for L2 readability prediction.
A Tutorial Markov Analysis of Effective Human Tutorial Sessions
Authors: Nabin Maharjan, Vasile Rus
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7

This paper investigates what differentiates effective tutorial sessions from less effective sessions. Towards this end, we characterize and explore human tutors{'} actions in tutorial dialogue sessions by mapping the tutor-tutee interactions, which are streams of dialogue utterances, into streams of actions, based on the language-as-action theory. Next, we use human expert judgment measures, evidence of learning (EL) and evidence of soundness (ES), to identify effective and ineffective sessions. We perform sub-sequence pattern mining to identify sub-sequences of dialogue modes that discriminate good sessions from bad sessions. We finally use the results of sub-sequence analysis method to generate a tutorial Markov process for effective tutorial sessions.
Thank ``Goodness''! A Way to Measure Style in Student Essays
Authors: S Mathias, eep, Pushpak Bhattacharyya
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Language Modeling, Language Modelling

Essays have two major components for scoring - content and style. In this paper, we describe a property of the essay, called goodness, and use it to predict the score given for the style of student essays. We compare our approach to solve this problem with baseline approaches, like language modeling and also a state-of-the-art deep learning system. We show that, despite being quite intuitive, our approach is very powerful in predicting the style of the essays.
Overview of NLPTEA-2018 Share Task Chinese Grammatical Error Diagnosis
Authors: Gaoqi Rao, Qi Gong, Baolin Zhang, Endong Xun
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Grammatical Error Correction, Position

This paper presents the NLPTEA 2018 shared task for Chinese Grammatical Error Diagnosis (CGED) which seeks to identify grammatical error types, their range of occurrence and recommended corrections within sentences written by learners of Chinese as foreign language. We describe the task definition, data preparation, performance metrics, and evaluation results. Of the 20 teams registered for this shared task, 13 teams developed the system and submitted a total of 32 runs. Progress in system performances was obviously, reaching F1 of 36.12{\%} in position level and 25.27{\%} in correction level. All data sets with gold standards and scoring scripts are made publicly available to researchers.
Chinese Grammatical Error Diagnosis using Statistical and Prior Knowledge driven Features with Probabilistic Ensemble Enhancement
Authors: Ruiji Fu, Zhengqi Pei, Jiefu Gong, Wei Song, Dechuan Teng, Wanxiang Che, Shijin Wang, Guoping Hu, Ting Liu
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Information Retrieval, Sentence

This paper describes our system at NLPTEA-2018 Task {\#}1: Chinese Grammatical Error Diagnosis. Grammatical Error Diagnosis is one of the most challenging NLP tasks, which is to locate grammar errors and tell error types. Our system is built on the model of bidirectional Long Short-Term Memory with a conditional random field layer (BiLSTM-CRF) but integrates with several new features. First, richer features are considered in the BiLSTM-CRF model; second, a probabilistic ensemble approach is adopted; third, Template Matcher are used during a post-processing to bring in human knowledge. In official evaluation, our system obtains the highest F1 scores at identifying error types and locating error positions, the second highest F1 score at sentence level error detection. We also recommend error corrections for specific error types and achieve the best F1 performance among all participants.
A Hybrid System for Chinese Grammatical Error Diagnosis and Correction
Authors: Chen Li, Junpei Zhou, Zuyi Bao, Hengyou Liu, Guangwei Xu, Linlin Li
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Grammatical Error Correction, TAG

This paper introduces the DM{\_}NLP team{'}s system for NLPTEA 2018 shared task of Chinese Grammatical Error Diagnosis (CGED), which can be used to detect and correct grammatical errors in texts written by Chinese as a Foreign Language (CFL) learners. This task aims at not only detecting four types of grammatical errors including redundant words (R), missing words (M), bad word selection (S) and disordered words (W), but also recommending corrections for errors of M and S types. We proposed a hybrid system including four models for this task with two stages: the detection stage and the correction stage. In the detection stage, we first used a BiLSTM-CRF model to tag potential errors by sequence labeling, along with some handcraft features. Then we designed three Grammatical Error Correction (GEC) models to generate corrections, which could help to tune the detection result. In the correction stage, candidates were generated by the three GEC models and then merged to output the final corrections for M and S types. Our system reached the highest precision in the correction subtask, which was the most challenging part of this shared task, and got top 3 on F1 scores for position detection of errors.
Ling@CASS Solution to the NLP-TEA CGED Shared Task 2018
Authors: Qinan Hu, Yongwei Zhang, Fang Liu, Yueguo Gu
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7

In this study, we employ the sequence to sequence learning to model the task of grammar error correction. The system takes potentially erroneous sentences as inputs, and outputs correct sentences. To breakthrough the bottlenecks of very limited size of manually labeled data, we adopt a semi-supervised approach. Specifically, we adapt correct sentences written by native Chinese speakers to generate pseudo grammatical errors made by learners of Chinese as a second language. We use the pseudo data to pre-train the model, and the CGED data to fine-tune it. Being aware of the significance of precision in a grammar error correction system in real scenarios, we use ensembles to boost precision. When using inputs as simple as Chinese characters, the ensembled system achieves a precision at 86.56{\%} in the detection of erroneous sentences, and a precision at 51.53{\%} in the correction of errors of Selection and Missing types.
Chinese Grammatical Error Diagnosis Based on Policy Gradient LSTM Model
Authors: Changliang Li, Ji Qi
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Chinese Word Segmentation, Sentence

Chinese Grammatical Error Diagnosis (CGED) is a natural language processing task for the NLPTEA2018 workshop held during ACL2018. The goal of this task is to diagnose Chinese sentences containing four kinds of grammatical errors through the model and find out the sentence errors. Chinese grammatical error diagnosis system is a very important tool, which can help Chinese learners automatically diagnose grammatical errors in many scenarios. However, due to the limitations of the Chinese language{'}s own characteristics and datasets, the traditional model faces the problem of extreme imbalances in the positive and negative samples and the disappearance of gradients. In this paper, we propose a sequence labeling method based on the Policy Gradient LSTM model and apply it to this task to solve the above problems. The results show that our model can achieve higher precision scores in the case of lower False positive rate (FPR) and it is convenient to optimize the model on-line.
The Importance of Recommender and Feedback Features in a Pronunciation Learning Aid
Authors: Dzikri Fudholi, Hanna Suominen
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Information Retrieval, Recommendation Systems, Reinforcement Learning, Retrieval, speech-recognition, Speech Recognition

Verbal communication {---} and pronunciation as its part {---} is a core skill that can be developed through guided learning. An artificial intelligence system can take a role in these guided learning approaches as an enabler of an application for pronunciation learning with a recommender system to guide language learners through exercises and feedback system to correct their pronunciation. In this paper, we report on a user study on language learners{'} perceived usefulness of the application. 16 international students who spoke non-native English and lived in Australia participated. 13 of them said they need to improve their pronunciation skills in English because of their foreign accent. The feedback system with features for pronunciation scoring, speech replay, and giving a pronunciation example was deemed essential by most of the respondents. In contrast, a clear dichotomy between the recommender system perceived as useful or useless existed; the system had features to prompt new common words or old poorly-scored words. These results can be used to target research and development from information retrieval and reinforcement learning for better and better recommendations to speech recognition and speech analytics for accent acquisition.
Selecting NLP Techniques to Evaluate Learning Design Objectives in Collaborative Multi-perspective Elaboration Activities
Authors: Aneesha Bakharia
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7

PerspectivesX is a multi-perspective elaboration tool designed to encourage learner submission and curation across a range of collaborative learning activities. In this paper, it is shown that the learning design objectives of collaborative learning activities can be evaluated using NLP techniques, but that careful analysis of learner impact and pedagogical intent are required in order to select appropriate techniques. In particular, this paper focuses on the NLP techniques required to deliver an instructor dashboard, personalized learner feedback and content recommendation within multi-perspective elaboration activities. Key NLP techniques considered for inclusion include summarization, topic modeling, paraphrase detection and diversified content recommendation.
Augmenting Textual Qualitative Features in Deep Convolution Recurrent Neural Network for Automatic Essay Scoring
Authors: Tirthankar Dasgupta, Abir Naskar, Lipika Dey, Rupsa Saha
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Sentence, Sentence Embeddings

In this paper we present a qualitatively enhanced deep convolution recurrent neural network for computing the quality of a text in an automatic essay scoring task. The novelty of the work lies in the fact that instead of considering only the word and sentence representation of a text, we try to augment the different complex linguistic, cognitive and psycological features associated within a text document along with a hierarchical convolution recurrent neural network framework. Our preliminary investigation shows that incorporation of such qualitative feature vectors along with standard word/sentence embeddings can give us better understanding about improving the overall evaluation of the input essays.
Joint learning of frequency and word embeddings for multilingual readability assessment
Authors: Dieu-Thu Le, Cam-Tu Nguyen, Xiaoliang Wang
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Word Embeddings

This paper describes two models that employ word frequency embeddings to deal with the problem of readability assessment in multiple languages. The task is to determine the difficulty level of a given document, i.e., how hard it is for a reader to fully comprehend the text. The proposed models show how frequency information can be integrated to improve the readability assessment. The experimental results testing on both English and Chinese datasets show that the proposed models improve the results notably when comparing to those using only traditional word embeddings.
MULLE: A grammar-based Latin language learning tool to supplement the classroom setting
Authors: Herbert Lange, Peter Ljungl{\"o}f
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Translation

MULLE is a tool for language learning that focuses on teaching Latin as a foreign language. It is aimed for easy integration into the traditional classroom setting and syllabus, which makes it distinct from other language learning tools that provide standalone learning experience. It uses grammar-based lessons and embraces methods of gamification to improve the learner motivation. The main type of exercise provided by our application is to practice translation, but it is also possible to shift the focus to vocabulary or morphology training.
Textual Features Indicative of Writing Proficiency in Elementary School Spanish Documents
Authors: Gemma Bel-Enguix, Diana Due{\~n}as Ch{\'a}vez, Arturo Curiel D{\'\i}az
Date: 2018-07-01 00:00:00
Proceeding: WS 2018 7
Tasks: Language Acquisition

Childhood acquisition of written language is not straightforward. Writing skills evolve differently depending on external factors, such as the conditions in which children practice their productions and the quality of their instructors{'} guidance. This can be challenging in low-income areas, where schools may struggle to ensure ideal acquisition conditions. Developing computational tools to support the learning process may counterweight negative environmental influences; however, few work exists on the use of information technologies to improve childhood literacy. This work centers around the computational study of Spanish word and syllable structure in documents written by 2nd and 3rd year elementary school students. The studied texts were compared against a corpus of short stories aimed at the same age group, so as to observe whether the children tend to produce similar written patterns as the ones they are expected to interpret at their literacy level. The obtained results show some significant differences between the two kinds of texts, pointing towards possible strategies for the implementation of new education software in support of written language acquisition.