pwc-archive/papers-with-abstracts huggingface dataset:
Mazajak: An Online Arabic Sentiment Analyser
Authors: Ibrahim Abu Farha, Walid Magdy
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Arabic Sentiment Analysis, Sentiment Analysis, Twitter Sentiment Analysis

Sentiment analysis (SA) is one of the most useful natural language processing applications. Literature is flooding with many papers and systems addressing this task, but most of the work is focused on English. In this paper, we present {``}Mazajak{''}, an online system for Arabic SA. The system is based on a deep learning model, which achieves state-of-the-art results on many Arabic dialect datasets including SemEval 2017 and ASTD. The availability of such system should assist various applications and research that rely on sentiment analysis as a tool.
The MADAR Shared Task on Arabic Fine-Grained Dialect Identification
Authors: Houda Bouamor, Sabit Hassan, Nizar Habash
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification

In this paper, we present the results and findings of the MADAR Shared Task on Arabic Fine-Grained Dialect Identification. This shared task was organized as part of The Fourth Arabic Natural Language Processing Workshop, collocated with ACL 2019. The shared task includes two subtasks: the MADAR Travel Domain Dialect Identification subtask (Subtask 1) and the MADAR Twitter User Dialect Identification subtask (Subtask 2). This shared task is the first to target a large set of dialect labels at the city and country levels. The data for the shared task was created or collected under the Multi-Arabic Dialect Applications and Resources (MADAR) project. A total of 21 teams from 15 countries participated in the shared task.
ZCU-NLP at MADAR 2019: Recognizing Arabic Dialects
Authors: Pavel P{\v{r}}ib{\'a}{\v{n}}, Stephen Taylor
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: BIG-bench Machine Learning, Dialect Identification, Language Modelling

In this paper, we present our systems for the MADAR Shared Task: Arabic Fine-Grained Dialect Identification. The shared task consists of two subtasks. The goal of Subtask{--} 1 (S-1) is to detect an Arabic city dialect in a given text and the goal of Subtask{--}2 (S-2) is to predict the country of origin of a Twitter user by using tweets posted by the user. In S-1, our proposed systems are based on language modelling. We use language models to extract features that are later used as an input for other machine learning algorithms. We also experiment with recurrent neural networks (RNN), but these experiments showed that simpler machine learning algorithms are more successful. Our system achieves 0.658 macro F1-score and our rank is 6th out of 19 teams in S-1 and 7th in S-2 with 0.475 macro F1-score.
Simple But Not Na\"\ive: Fine-Grained Arabic Dialect Identification Using Only N-Grams
Authors: Sohaila Eltanbouly, May Bashendy, Tamer Elsayed
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, Sentence

This paper presents the participation of Qatar University team in MADAR shared task, which addresses the problem of sentence-level fine-grained Arabic Dialect Identification over 25 different Arabic dialects in addition to the Modern Standard Arabic. Arabic Dialect Identification is not a trivial task since different dialects share some features, e.g., utilizing the same character set and some vocabularies. We opted to adopt a very simple approach in terms of extracted features and classification models; we only utilize word and character n-grams as features, and Na ̈{\i}ve Bayes models as classifiers. Surprisingly, the simple approach achieved non-na ̈{\i}ve performance. The official results, reported on a held-out testing set, show that the dialect of a given sentence can be identified at an accuracy of 64.58{\%} by our best submitted run.
LIUM-MIRACL Participation in the MADAR Arabic Dialect Identification Shared Task
Authors: Sam{\'e}h Kchaou, Fethi Bougares, Lamia Hadrich-Belguith
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Deep Learning, Dialect Identification, Sentence

This paper describes the joint participation of the LIUM and MIRACL Laboratories at the Arabic dialect identification challenge of the MADAR Shared Task (Bouamor et al., 2019) conducted during the Fourth Arabic Natural Language Processing Workshop (WANLP 2019). We participated to the Travel Domain Dialect Identification subtask. We built several systems and explored different techniques including conventional machine learning methods and deep learning algorithms. Deep learning approaches did not perform well on this task. We experimented several classification systems and we were able to identify the dialect of an input sentence with an F1-score of 65.41{\%} on the official test set using only the training data supplied by the shared task organizers.
Arabic Dialect Identification with Deep Learning and Hybrid Frequency Based Features
Authors: Youssef Fares, Zeyad El-Zanaty, Kareem Abdel-Salam, Muhammed Ezzeldin, Aliaa Mohamed, Karim El-Awaad, Marwan Torki
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification

Studies on Dialectical Arabic are growing more important by the day as it becomes the primary written and spoken form of Arabic online in informal settings. Among the important problems that should be explored is that of dialect identification. This paper reports different techniques that can be applied towards such goal and reports their performance on the Multi Arabic Dialect Applications and Resources (MADAR) Arabic Dialect Corpora. Our results show that improving on traditional systems using frequency based features and non deep learning classifiers is a challenging task. We propose different models based on different word and document representations. Our top model is able to achieve an F1 macro averaged score of 65.66 on MADAR{'}s small-scale parallel corpus of 25 dialects and Modern Standard Arabic (MSA).
MICHAEL: Mining Character-level Patterns for Arabic Dialect Identification (MADAR Challenge)
Authors: Dhaou Ghoul, Ga{\"e}l Lejeune
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, General Classification

We present MICHAEL, a simple lightweight method for automatic Arabic Dialect Identification on the MADAR travel domain Dialect Identification (DID). MICHAEL uses simple character-level features in order to perform a pre-processing free classification. More precisely, Character N-grams extracted from the original sentences are used to train a Multinomial Naive Bayes classifier. This system achieved an official score (accuracy) of 53.25{\%} with 1{\textless}=N{\textless}=3 but showed a much better result with character 4-grams (62.17{\%} accuracy).
Arabic Dialect Identification for Travel and Twitter Text
Authors: Pruthwik Mishra, V Mujadia, an
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: BIG-bench Machine Learning, Dialect Identification, Language Modeling, Language Modelling

This paper presents the results of the experiments done as a part of MADAR Shared Task in WANLP 2019 on Arabic Fine-Grained Dialect Identification. Dialect Identification is one of the prominent tasks in the field of Natural language processing where the subsequent language modules can be improved based on it. We explored the use of different features like char, word n-gram, language model probabilities, etc on different classifiers. Results show that these features help to improve dialect classification accuracy. Results also show that traditional machine learning classifier tends to perform better when compared to neural network models on this task in a low resource setting.
Mawdoo3 AI at MADAR Shared Task: Arabic Tweet Dialect Identification
Authors: Bashar Talafha, Wael Farhan, Ahmed Altakrouri, Hussein Al-Natsheh
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Deep Learning, Dialect Identification

Arabic dialect identification is an inherently complex problem, as Arabic dialect taxonomy is convoluted and aims to dissect a continuous space rather than a discrete one. In this work, we present machine and deep learning approaches to predict 21 fine-grained dialects form a set of given tweets per user. We adopted numerous feature extraction methods most of which showed improvement in the final model, such as word embedding, Tf-idf, and other tweet features. Our results show that a simple LinearSVC can outperform any complex deep learning model given a set of curated features. With a relatively complex user voting mechanism, we were able to achieve a Macro-Averaged F1-score of 71.84{\%} on MADAR shared subtask-2. Our best submitted model ranked second out of all participating teams.
Mawdoo3 AI at MADAR Shared Task: Arabic Fine-Grained Dialect Identification with Ensemble Learning
Authors: Ahmad Ragab, Haitham Seelawi, Mostafa Samir, Abdelrahman Mattar, Hesham Al-Bataineh, Mohammad Zaghloul, Ahmad Mustafa, Bashar Talafha, Abed Alhakim Freihat, Hussein Al-Natsheh
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, Ensemble Learning

In this paper we discuss several models we used to classify 25 city-level Arabic dialects in addition to Modern Standard Arabic (MSA) as part of MADAR shared task (sub-task 1). We propose an ensemble model of a group of experimentally designed best performing classifiers on a various set of features. Our system achieves an accuracy of 69.3{\%} macro F1-score with an improvement of 1.4{\%} accuracy from the baseline model on the DEV dataset. Our best run submitted model ranked as third out of 19 participating teams on the TEST dataset with only 0.12{\%} macro F1-score behind the top ranked system.
Hierarchical Deep Learning for Arabic Dialect Identification
Authors: Gael de Francony, Victor Guichard, Praveen Joshi, Haithem Afli, Abdessalam Bouchekif
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Classification, Deep Learning, Dialect Identification, General Classification, Sentence

In this paper, we present two approaches for Arabic Fine-Grained Dialect Identification. The first approach is based on Recurrent Neural Networks (BLSTM, BGRU) using hierarchical classification. The main idea is to separate the classification process for a sentence from a given text in two stages. We start with a higher level of classification (8 classes) and then the finer-grained classification (26 classes). The second approach is given by a voting system based on Naive Bayes and Random Forest. Our system achieves an F1 score of 63.02 {\%} on the subtask evaluation dataset.
ArbDialectID at MADAR Shared Task 1: Language Modelling and Ensemble Learning for Fine Grained Arabic Dialect Identification
Authors: Kathrein Abu Kwaik, Motaz Saad
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, Ensemble Learning, Feature Engineering, Language Modelling, Sentence

In this paper, we present a Dialect Identification system (ArbDialectID) that competed at Task 1 of the MADAR shared task, MADARTravel Domain Dialect Identification. We build a course and a fine-grained identification model to predict the label (corresponding to a dialect of Arabic) of a given text. We build two language models by extracting features at two levels (words and characters). We firstly build a coarse identification model to classify each sentence into one out of six dialects, then use this label as a feature for the fine-grained model that classifies the sentence among 26 dialects from different Arab cities, after that we apply ensemble voting classifier on both sub-systems. Our system ranked 1st that achieving an f-score of 67.32{\%}. Both the models and our feature engineering tools are made available to the research community.
The SMarT Classifier for Arabic Fine-Grained Dialect Identification
Authors: Karima Meftouh, Karima Abidi, Salima Harrat, Kamel Smaili
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, Language Modeling, Language Modelling

This paper describes the approach adopted by the SMarT research group to build a dialect identification system in the framework of the Madar shared task on Arabic fine-grained dialect identification. We experimented several approaches, but we finally decided to use a Multinomial Naive Bayes classifier based on word and character ngrams in addition to the language model probabilities. We achieved a score of 67.73{\%} in terms of Macro accuracy and a macro-averaged F1-score of 67.31{\%}
JHU System Description for the MADAR Arabic Dialect Identification Shared Task
Authors: Tom Lippincott, Pamela Shapiro, Kevin Duh, Paul McNamee
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, Language Modeling, Language Modelling, Word Embeddings

Our submission to the MADAR shared task on Arabic dialect identification employed a language modeling technique called Prediction by Partial Matching, an ensemble of neural architectures, and sources of additional data for training word embeddings and auxiliary language models. We found several of these techniques provided small boosts in performance, though a simple character-level language model was a strong baseline, and a lower-order LM achieved best performance on Subtask 2. Interestingly, word embeddings provided no consistent benefit, and ensembling struggled to outperform the best component submodel. This suggests the variety of architectures are learning redundant information, and future work may focus on encouraging decorrelated learning.
ST MADAR 2019 Shared Task: Arabic Fine-Grained Dialect Identification
Authors: Mourad Abbas, Mohamed Lichouri, Abed Alhakim Freihat
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, regression

This paper describes the solution that we propose on MADAR 2019 Arabic Fine-Grained Dialect Identification task. The proposed solution utilized a set of classifiers that we trained on character and word features. These classifiers are: Support Vector Machines (SVM), Bernoulli Naive Bayes (BNB), Multinomial Naive Bayes (MNB), Logistic Regression (LR), Stochastic Gradient Descent (SGD), Passive Aggressive(PA) and Perceptron (PC). The system achieved competitive results, with a performance of 62.87 {\%} and 62.12 {\%} for both development and test sets.
A Character Level Convolutional BiLSTM for Arabic Dialect Identification
Authors: Mohamed Elaraby, Ahmed Zahran
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: 2k, Dialect Identification

In this paper, we describe CU-RAISA teamcontribution to the 2019Madar shared task2, which focused on Twitter User fine-grained dialect identification.Among par-ticipating teams, our system ranked the4th(with 61.54{\%}) F1-Macro measure.Our sys-tem is trained using a character level convo-lutional bidirectional long-short-term memorynetwork trained on 2k users{'} data. We showthat training on concatenated user tweets asinput is further superior to training on usertweets separately and assign user{'}s label on themode of user{'}s tweets{'} predictions.
No Army, No Navy: BERT Semi-Supervised Learning of Arabic Dialects
Authors: Chiyu Zhang, Muhammad Abdul-Mageed
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification, Task 2

We present our deep leaning system submitted to MADAR shared task 2 focused on twitter user dialect identification. We develop tweet-level identification models based on GRUs and BERT in supervised and semi-supervised set-tings. We then introduce a simple, yet effective, method of porting tweet-level labels at the level of users. Our system ranks top 1 in the competition, with 71.70{\%} macro F1 score and 77.40{\%} accuracy.
Team JUST at the MADAR Shared Task on Arabic Fine-Grained Dialect Identification
Authors: Bashar Talafha, Ali Fadel, Mahmoud Al-Ayyoub, Yaser Jararweh, Mohammad AL-Smadi, Patrick Juola
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Data Augmentation, Dialect Identification, Language Modeling, Language Modelling

In this paper, we describe our team{'}s effort on the MADAR Shared Task on Arabic Fine-Grained Dialect Identification. The task requires building a system capable of differentiating between 25 different Arabic dialects in addition to MSA. Our approach is simple. After preprocessing the data, we use Data Augmentation (DA) to enlarge the training data six times. We then build a language model and extract n-gram word-level and character-level TF-IDF features and feed them into an MNB classifier. Despite its simplicity, the resulting model performs really well producing the 4th highest F-measure and region-level accuracy and the 5th highest precision, recall, city-level accuracy and country-level accuracy among the participating teams.
QC-GO Submission for MADAR Shared Task: Arabic Fine-Grained Dialect Identification
Authors: Younes Samih, Hamdy Mubarak, Ahmed Abdelali, Mohammed Attia, Mohamed Eldesouki, Kareem Darwish
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Dialect Identification

This paper describes the QC-GO team submission to the MADAR Shared Task Subtask 1 (travel domain dialect identification) and Subtask 2 (Twitter user location identification). In our participation in both subtasks, we explored a number of approaches and system combinations to obtain the best performance for both tasks. These include deep neural nets and heuristics. Since individual approaches suffer from various shortcomings, the combination of different approaches was able to fill some of these gaps. Our system achieves F1-Scores of 66.1{\%} and 67.0{\%} on the development sets for Subtasks 1 and 2 respectively.
From Insanely Jealous to Insanely Delicious: Computational Models for the Semantic Bleaching of English Intensifiers
Authors: Yiwei Luo, Dan Jurafsky, Beth Levin
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8

We introduce novel computational models for modeling semantic bleaching, a widespread category of change in which words become more abstract or lose elements of meaning, like the development of {``}arrive{''} from its earlier meaning {`}become at shore.{'} We validate our methods on a widespread case of bleaching in English: de-adjectival adverbs that originate as manner adverbs (as in {``}awfully behaved{''}) and later become intensifying adverbs (as in {``}awfully nice{''}). Our methods formally quantify three reflexes of bleaching: decreasing similarity to the source meaning (e.g., {``}awful{''}), increasing similarity to a fully bleached prototype (e.g., {``}very{''}), and increasing productivity (e.g., the breadth of adjectives that an adverb modifies). We also test a new causal model and find evidence that bleaching is initially triggered in contexts such as {``}conspicuously evident{''} and {``}insanely jealous{''}, where an adverb premodifies a semantically similar adjective. These contexts provide a form of {``}bridging context{''} (Evans and Wilkins, 2000) that allow a manner adverb to be reinterpreted as an intensifying adverb similar to {``}very{''}.
Computational Analysis of the Historical Changes in Poetry and Prose
Authors: Amitha Gopidi, Aniket Alam
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8

The esoteric definitions of poetry are insufficient in enveloping the changes in poetry that the age of mechanical reproduction has witnessed with the widespread proliferation of the use of digital media and artificial intelligence. They are also insufficient in distinguishing between prose and poetry, as the content of both prose and poetry can be poetic. Using quotes as prose considering their poetic, context-free and celebrated nature, stylistic differences between poetry and prose are delved into. Novel features in grammar and meter are justified as distinguishing features. Datasets of popular prose and poetry spanning across 1870-1920 and 1970-2019 have been created, and multiple experiments have been conducted to prove that prose and poetry in the latter period are more alike than they were in the former. The accuracy of classification of poetry and prose of 1970-2019 is significantly lesser than that of 1870-1920, thereby proving the convergence of poetry and prose in 1970-2019.
Studying Semantic Chain Shifts with Word2Vec: FOOD\textgreaterMEAT\textgreaterFLESH
Authors: Richard Zimmermann
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8

Word2Vec models are used to study the semantic chain shift FOOD{\textgreater}MEAT{\textgreater}FLESH in the history of English, c. 1425-1925. The development stretches out over a long time, starting before 1500, and may possibly be continuing to this day. The semantic changes likely proceeded as a push chain.
Evaluation of Semantic Change of Harm-Related Concepts in Psychology
Authors: Ekaterina Vylomova, Sean Murphy, Nicholas Haslam
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8

The paper focuses on diachronic evaluation of semantic changes of harm-related concepts in psychology. More specifically, we investigate a hypothesis that certain concepts such as {``}addiction{''}, {``}bullying{''}, {``}harassment{''}, {``}prejudice{''}, and {``}trauma{''} became broader during the last four decades. We evaluate semantic changes using two models: an LSA-based model from Sagi et al. (2009) and a diachronic adaptation of word2vec from Hamilton et al. (2016), that are trained on a large corpus of journal abstracts covering the period of 1980{--} 2019. Several concepts showed evidence of broadening. {``}Addiction{''} moved from physiological dependency on a substance to include psychological dependency on gaming and the Internet. Similarly, {``}harassment{''} and {``}trauma{''} shifted towards more psychological meanings. On the other hand, {``}bullying{''} has transformed into a more victim-related concept and expanded to new areas such as workplaces.
Contextualized Diachronic Word Representations
Authors: Ganesh Jawahar, Djam{\'e} Seddah
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8
Tasks: Diachronic Word Embeddings, Inductive Bias, Word Embeddings

Diachronic word embeddings play a key role in capturing interesting patterns about how language evolves over time. Most of the existing work focuses on studying corpora spanning across several decades, which is understandably still not a possibility when working on social media-based user-generated content. In this work, we address the problem of studying semantic changes in a large Twitter corpus collected over five years, a much shorter period than what is usually the norm in diachronic studies. We devise a novel attentional model, based on Bernoulli word embeddings, that are conditioned on contextual extra-linguistic (social) features such as network, spatial and socio-economic variables, which are associated with Twitter users, as well as topic-based features. We posit that these social features provide an inductive bias that helps our model to overcome the narrow time-span regime problem. Our extensive experiments reveal that our proposed model is able to capture subtle semantic shifts without being biased towards frequency cues and also works well when certain contextual features are absent. Our model fits the data better than current state-of-the-art dynamic word embedding models and therefore is a promising tool to study diachronic semantic changes over small time periods.
Modeling Markedness with a Split-and-Merger Model of Sound Change
Authors: Andrea Ceolin, Ollie Sayeed
Date: 2019-08-01 00:00:00
Proceeding: WS 2019 8

The concept of {`}markedness{'} has been influential in phonology for almost a century. Theoretical phonology has found it useful to describe some segments as more {`}marked{'} than others, referring to a cluster of language-internal and -external properties (Jakobson 1968, Haspelmath 2006). We argue, using a simple mathematical model based on Evolutionary Phonology (Blevins 2004), that markedness is an epiphenomenon of phonetically grounded sound change.