pwc-archive/papers-with-abstracts huggingface dataset:
Challenges of Driver Drowsiness Prediction: The Remaining Steps to Implementation
Authors: Emma Perkins, Chiranjibi Sitaula, Michael Burke, Faezeh Marzbanrad
Date: 2021-09-17 00:00:00
Tasks: EEG, Electroencephalogram (EEG)

Driver drowsiness has caused a large number of serious injuries and deaths on public roads and incurred billions of taxpayer dollars in costs. Hence, monitoring of drowsiness is critical to reduce this burden on society. This paper surveys the broad range of solutions proposed to address the challenges of driver drowsiness, and identifies the key steps required for successful implementation. Although some commercial products already exist, with vehicle-based methods most commonly implemented by automotive manufacturers, these systems may not have the level of accuracy required to properly predict and monitor drowsiness. State-of-the-art models use physiological, behavioural and vehicle-based methods to detect drowsiness, with hybrid methods emerging as a superior approach. Current setbacks to implementing these methods include late detection, intrusiveness and subject diversity. In particular, physiological monitoring methods such as Electroencephalography (EEG) are intrusive to drivers; while behavioural monitoring is least robust, affected by external factors such as lighting, as well as being subject to privacy concerns. Drowsiness detection models are often developed and validated based on subjective measures, with the Karolinska Sleepiness Scale being the most popular. Subjective and incoherent labelling of drowsiness, lack of on road data and inconsistent protocols for data collection are among other challenges to be addressed to progress drowsiness detection for reliable on-road use.
A Data-Driven Uncertainty Quantification Method for Stochastic Economic Dispatch
Authors: Xiaoting Wang, Rong-Peng Liu, Xiaozhe Wang, Yunhe Hou, François Bouffard
Date: 2021-09-16 00:00:00
Tasks: Uncertainty Quantification

This letter proposes a data-driven sparse polynomial chaos expansion-based surrogate model for the stochastic economic dispatch problem considering uncertainty from wind power. The proposed method can provide accurate estimations for the statistical information (e.g., mean, variance, probability density function, and cumulative distribution function) for the stochastic economic dispatch solution efficiently without requiring the probability distributions of random inputs. Simulation studies on an integrated electricity and gas system (IEEE 118-bus system integrated with a 20-node gas system are presented, demonstrating the efficiency and accuracy of the proposed method compared to the Monte Carlo simulations.
Review of the mechanisms of SARS-CoV-2 evolution and transmission
Authors: Jiahui Chen, Rui Wang, Guo-Wei Wei
Date: 2021-09-15 00:00:00

The mechanism of SARS-CoV-2 evolution and transmission is elusive and its understanding, a prerequisite to forecast emerging variants, is of paramount importance. SARS-CoV-2 evolution is driven by the mechanisms at molecular and organism scales and regulated by the transmission pathways at the population scale. In this review, we show that infectivity-based natural selection was discovered as the mechanism for SARS-CoV-2 evolution and transmission in July 2020. In April 2021, we proved beyond all doubt that such a natural selection via infectivity-based transmission pathway remained the sole mechanism for SARS-CoV-2 evolution. However, we reveal that antibody-disruptive co-mutations [Y449S, N501Y] debuted as a new vaccine-resistant transmission pathway of viral evolution in highly vaccinated populations a few months ago. Over one year ago, we foresaw that mutations spike protein RBD residues, 452 and 501, would "have high chances to mutate into significantly more infectious COVID-19 strains". Mutations on these residues underpin prevailing SARS-CoV-2 variants Alpha, Beta, Gamma, Delta, Epsilon, Theta, Kappa, Lambda, and Mu at present and are expected to be vital to emerging variants. We anticipate that viral evolution will combine RBD co-mutations at these two sites, creating future variants that are tens of times more infectious than the original SARS-CoV-2. Additionally, two complementary transmission pathways of viral evolution: infectivity and vaccine-resistant, will prolong our battle with COVID-19 for years. We predict that RBD co-mutation [A411S, L452R, T478K], [L452R, T478K, N501Y], [L452R, T478K, E484K, N501Y], [K417N, L452R, T478K], and [P384L, K417N, E484K, N501Y] will have high chances to grow into dominating variants due to their high infectivity and/or strong ability to break through current vaccines, calling for the development of new vaccines and antibody therapies.
Controlled Comparison of Simulated Hemodynamics across Tricuspid and Bicuspid Aortic Valves
Authors: Alexander D. Kaiser, Rohan Shad, Nicole Schiavone, William Hiesinger, Alison L. Marsden
Date: 2021-09-17 00:00:00

Bicuspid aortic valve is the most common congenital heart defect, affecting 1-2% of the global population. Patients with bicuspid valves frequently develop dilation and aneurysms of the ascending aorta. Both hemodynamic and genetic factors are believed to contribute to dilation, yet the precise mechanism underlying this progression remains under debate. Controlled comparisons of hemodynamics in patients with different forms of bicuspid valve disease are challenging because of confounding factors, and simulations offer the opportunity for direct and systematic comparisons. Using fluid-structure interaction simulations, we simulate flows through multiple aortic valve models in a patient-specific geometry. The aortic geometry is based on a healthy patient with no known aortic or valvular disease, which allows us to isolate the hemodynamic consequences of changes to the valve alone. Four fully-passive, elastic model valves are studied: a tricuspid valve and bicuspid valves with fusion of the left- and right-, right- and non-, and non- and left-coronary cusps. The resulting tricuspid flow is relatively uniform, with little secondary or reverse flow, and little to no pressure gradient across the valve. The bicuspid cases show localized jets of forward flow, excess streamwise momentum, elevated secondary and reverse flow, and clinically significant levels of stenosis. Localized high flow rates correspond to locations of dilation observed in patients, with the location related to which valve cusps are fused. Thus, the simulations support the hypothesis that chronic exposure to high local flow contributes to localized dilation and aneurysm formation.
Trading styles and long-run variance of asset prices
Authors: Lawrence Middleton, James Dodd, Simone Rijavec
Date: 2021-09-16 00:00:00
Tasks: Time Series, Time Series Analysis

Trading styles can be classified into either trend-following or mean-reverting. If the net trading style is trend-following the traded asset is more likely to move in the same direction it moved previously (the opposite is true if the net style is mean-reverting). The result of this is to introduce positive (or negative) correlations into the time series. We here explore the effect of these correlations on the long-run variance of the series through probabilistic models designed to explicitly capture the direction of trading. Our theoretical insights suggests that relative to random walk models of asset prices the long-run variance is increased under trend-following strategies and can actually be reduced under mean-reversal conditions. We apply these models to some of the largest US stocks by market capitalisation as well as high-frequency EUR/USD data and show that in both these settings, the ability to predict the asset price is generally increased relative to a random walk.
Efficient Measuring of Readability to Improve Documents Accessibility for Arabic Language Learners
Authors: Sadik Bessou, Ghozlane Chenni
Date: 2021-09-09 00:00:00
Tasks: BIG-bench Machine Learning

This paper presents an approach based on supervised machine learning methods to build a classifier that can identify text complexity in order to present Arabic language learners with texts suitable to their levels. The approach is based on machine learning classification methods to discriminate between the different levels of difficulty in reading and understanding a text. Several models were trained on a large corpus mined from online Arabic websites and manually annotated. The model uses both Count and TF-IDF representations and applies five machine learning algorithms; Multinomial Naive Bayes, Bernoulli Naive Bayes, Logistic Regression, Support Vector Machine and Random Forest, using unigrams and bigrams features. With the goal of extracting the text complexity, the problem is usually addressed by formulating the level identification as a classification task. Experimental results showed that n-gram features could be indicative of the reading level of a text and could substantially improve performance, and showed that SVM and Multinomial Naive Bayes are the most accurate in predicting the complexity level. Best results were achieved using TF-IDF Vectors trained by a combination of word-based unigrams and bigrams with an overall accuracy of 87.14% over four classes of complexity.
Monitoring Indoor Activity of Daily Living Using Thermal Imaging: A Case Study
Authors: Hassan M. Ahmed, Bessam Abdulrazak
Date: 2021-09-06 00:00:00

Monitoring indoor activities of daily living (ADLs) of a person is neither an easy nor an accurate process. It is subjected to dependency on sensor type, power supply stability, and connectivity stability without mentioning artifacts introduced by the person himself. Multiple challenges have to be overcome in this field, such as; monitoring the precise spatial location of the person, and estimating vital signs like an individuals average temperature. Privacy is another domain of the problem to be thought of with care. Identifying the persons posture without a camera is another challenge. Posture identification assists in the persons fall detection. Thermal imaging could be a proper solution for most of the mentioned challenges. It provides monitoring both the persons average temperature and spatial location while maintaining privacy. In this research, we propose an IoT system for monitoring an indoor ADL using thermal sensor array (TSA). Three classes of ADLs are introduced, which are daily activity, sleeping activity and no-activity respectively. Estimating person average temperature using TSAs is introduced as well in this paper. Results have shown that the three activity classes can be identified as well as the persons average temperature during day and night. The persons spatial location can be determined while his/her privacy is maintained as well.
Sinoledge: A Knowledge Engine based on Logical Reasoning and Distributed Micro Services
Authors: Yining Huang, Shaoze Lin, Yijun Wei, Keke Tang
Date: 2021-08-29 00:00:00
Tasks: Logical Reasoning

We propose a knowledge engine called Sinoledge mainly for doctors, physicians, and researchers in medical field to organize thoughts, manage reasoning process, test and deploy to production environments effortlessly. Our proposal can be related to rule engine usually used in business or medical fields. More importantly, our proposal provides a user-friendly interface, an easy-maintain way of organizing knowledge, an understandable testing functionality and a highly available and efficient back-end architecture.
Words with Consistent Diachronic Usage Patterns are Learned Earlier: A Computational Analysis Using Temporally Aligned Word Embeddings
Authors: Giovanni Cassani, Federico Bianchi, Marco Marelli
Date: 2021-04-20 00:00:00
Proceeding: Cognitive Science 2021 4
Tasks: Diachronic Word Embeddings, Diversity, Relation, Word Embeddings

In this study, we use temporally aligned word embeddings and a large diachronic corpus of English to quantify language change in a data-driven, scalable way, which is grounded in language use. We show a unique and reliable relation between measures of language change and age of acquisition (AoA) while controlling for frequency, contextual diversity, concreteness, length, dominant part of speech, orthographic neighborhood density, and diachronic frequency variation. We analyze measures of language change tackling both the change in lexical representations and the change in the relation between lexical representations and the words with the most similar usage patterns, showing that they capture different aspects of language change. Our results show a unique relation between language change and AoA, which is stronger when considering neighborhood-level measures of language change: Words with more coherent diachronic usage patterns tend to be acquired earlier. The results support theories positing a link between ontogenetic and ethnogenetic processes in language.
ReaSCAN: Compositional Reasoning in Language Grounding
Authors: Zhengxuan Wu, Elisa Kreiss, Desmond C. Ong, Christopher Potts
Date: 2021-09-18 00:00:00

The ability to compositionally map language to referents, relations, and actions is an essential component of language understanding. The recent gSCAN dataset (Ruis et al. 2020, NeurIPS) is an inspiring attempt to assess the capacity of models to learn this kind of grounding in scenarios involving navigational instructions. However, we show that gSCAN's highly constrained design means that it does not require compositional interpretation and that many details of its instructions and scenarios are not required for task success. To address these limitations, we propose ReaSCAN, a benchmark dataset that builds off gSCAN but requires compositional language interpretation and reasoning about entities and relations. We assess two models on ReaSCAN: a multi-modal baseline and a state-of-the-art graph convolutional neural model. These experiments show that ReaSCAN is substantially harder than gSCAN for both neural architectures. This suggests that ReaSCAN can serve as a valuable benchmark for advancing our understanding of models' compositional generalization and reasoning capabilities.
Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causes
Authors: Hyunwoo Kim, Byeongchang Kim, Gunhee Kim
Date: 2021-09-18 00:00:00
Proceeding: EMNLP 2021 11
Tasks: Dialogue Generation, Emotion Recognition, Empathetic Response Generation, Recognizing Emotion Cause in Conversations, Response Generation

Empathy is a complex cognitive ability based on the reasoning of others' affective states. In order to better understand others and express stronger empathy in dialogues, we argue that two issues must be tackled at the same time: (i) identifying which word is the cause for the other's emotion from his or her utterance and (ii) reflecting those specific words in the response generation. However, previous approaches for recognizing emotion cause words in text require sub-utterance level annotations, which can be demanding. Taking inspiration from social cognition, we leverage a generative estimator to infer emotion cause words from utterances with no word-level label. Also, we introduce a novel method based on pragmatics to make dialogue models focus on targeted words in the input during generation. Our method is applicable to any dialogue models with no additional training on the fly. We show our approach improves multiple best-performing dialogue agents on generating more focused empathetic responses in terms of both automatic and human evaluation.
Learning to Forecast Dynamical Systems from Streaming Data
Authors: Dimitris Giannakis, Amelia Henriksen, Joel A. Tropp, Rachel Ward
Date: 2021-09-20 00:00:00
Tasks: regression, Time Series, Time Series Analysis

Kernel analog forecasting (KAF) is a powerful methodology for data-driven, non-parametric forecasting of dynamically generated time series data. This approach has a rigorous foundation in Koopman operator theory and it produces good forecasts in practice, but it suffers from the heavy computational costs common to kernel methods. This paper proposes a streaming algorithm for KAF that only requires a single pass over the training data. This algorithm dramatically reduces the costs of training and prediction without sacrificing forecasting skill. Computational experiments demonstrate that the streaming KAF method can successfully forecast several classes of dynamical systems (periodic, quasi-periodic, and chaotic) in both data-scarce and data-rich regimes. The overall methodology may have wider interest as a new template for streaming kernel regression.
Training Dynamic based data filtering may not work for NLP datasets
Authors: Arka Talukdar, Monika Dagar, Prachi Gupta, Varun Menon
Date: 2021-09-19 00:00:00
Proceeding: EMNLP (BlackboxNLP) 2021 11
Tasks: Memorization, Natural Language Understanding

The recent increase in dataset size has brought about significant advances in natural language understanding. These large datasets are usually collected through automation (search engines or web crawlers) or crowdsourcing which inherently introduces incorrectly labeled data. Training on these datasets leads to memorization and poor generalization. Thus, it is pertinent to develop techniques that help in the identification and isolation of mislabelled data. In this paper, we study the applicability of the Area Under the Margin (AUM) metric to identify and remove/rectify mislabelled examples in NLP datasets. We find that mislabelled samples can be filtered using the AUM metric in NLP datasets but it also removes a significant number of correctly labeled points and leads to the loss of a large amount of relevant language information. We show that models rely on the distributional information instead of relying on syntactic and semantic representations.
Identifying Autism Spectrum Disorder Based on Individual-Aware Down-Sampling and Multi-Modal Learning
Authors: Li Pan, Jundong Liu, Mingqin Shi, Chi Wah Wong, Kei Hang Katie Chan
Date: 2021-09-19 00:00:00

Autism Spectrum Disorder(ASD) is a set of neurodevelopmental conditions that affect patients' social abilities. In recent years, many studies have employed deep learning to diagnose this brain dysfunction through functional MRI (fMRI). However, existing approaches solely focused on the abnormal brain functional connections but ignored the impact of regional activities. Due to this biased prior knowledge, previous diagnosis models suffered from inter-site measurement heterogeneity and inter-individual phenotypic differences. To address this issue, we propose a novel feature extraction method for fMRI that can learn a personalized lower-resolution representation of the entire brain networking regarding both the functional connections and regional activities. Specifically, we abstract the brain imaging as a graph structure and straightforwardly downsample it to substructures by hierarchical graph pooling. To further recalibrate the distribution of the extracted features under phenotypic information, we subsequently embed the sparse feature vectors into a population graph, where the hidden inter-subject heterogeneity and homogeneity are explicitly expressed as inter- and intra-community connectivity differences, and utilize Graph Convolutional Networks to learn the node embeddings. By these means, our framework can extract features directly and efficiently from the entire fMRI and be aware of implicit inter-individual variance. We have evaluated our framework on the ABIDE-I dataset with 10-fold cross-validation. The present model has achieved a mean classification accuracy of 87.62\% and a mean AUC of 0.92, better than the state-of-the-art methods.
Model Bias in NLP -- Application to Hate Speech Classification using transfer learning techniques
Authors: Aygul Zagidullina, Georgios Patoulidis, Jonas Bokstaller
Date: 2021-09-20 00:00:00
Tasks: Transfer Learning

In this paper, a BERT based neural network model is applied to the JIGSAW data set in order to create a model identifying hateful and toxic comments (strictly seperated from offensive language) in online social platforms (English language), in this case Twitter. Three other neural network architectures and a GPT-2 model are also applied on the provided data set in order to compare these different models. The trained BERT model is then applied on two different data sets to evaluate its generalisation power, namely on another Twitter data set and the data set HASOC 2019 which includes Twitter and also Facebook comments; we focus on the English HASOC 2019 data. In addition, it can be shown that by fine-tuning the trained BERT model on these two data sets by applying different transfer learning scenarios via retraining partial or all layers the predictive scores improve compared to simply applying the model pre-trained on the JIGSAW data set. With our results, we get precisions from 64% to around 90% while still achieving acceptable recall values of at least lower 60s%, proving that BERT is suitable for real use cases in social platforms.
A Plug-and-Play Method for Controlled Text Generation
Authors: Damian Pascual, Beni Egressy, Clara Meister, Ryan Cotterell, Roger Wattenhofer
Date: 2021-09-20 00:00:00
Proceeding: Findings (EMNLP) 2021 11
Tasks: Sentence, Story Generation, Text Generation

Large pre-trained language models have repeatedly shown their ability to produce fluent text. Yet even when starting from a prompt, generation can continue in many plausible directions. Current decoding methods with the goal of controlling generation, e.g., to ensure specific words are included, either require additional models or fine-tuning, or work poorly when the task at hand is semantically unconstrained, e.g., story generation. In this work, we present a plug-and-play decoding method for controlled language generation that is so simple and intuitive, it can be described in a single sentence: given a topic or keyword, we add a shift to the probability distribution over our vocabulary towards semantically similar words. We show how annealing this distribution can be used to impose hard constraints on language generation, something no other plug-and-play method is currently able to do with SOTA language generators. Despite the simplicity of this approach, we see it works incredibly well in practice: decoding from GPT-2 leads to diverse and fluent sentences while guaranteeing the appearance of given guide words. We perform two user studies, revealing that (1) our method outperforms competing methods in human evaluations; and (2) forcing the guide words to appear in the generated text has no impact on the fluency of the generated text.
BERT Cannot Align Characters
Authors: Antonis Maronikolakis, Philipp Dufter, Hinrich Schütze
Date: 2021-09-20 00:00:00
Proceeding: EMNLP (insights) 2021 11

In previous work, it has been shown that BERT can adequately align cross-lingual sentences on the word level. Here we investigate whether BERT can also operate as a char-level aligner. The languages examined are English, Fake-English, German and Greek. We show that the closer two languages are, the better BERT can align them on the character level. BERT indeed works well in English to Fake-English alignment, but this does not generalize to natural languages to the same extent. Nevertheless, the proximity of two languages does seem to be a factor. English is more related to German than to Greek and this is reflected in how well BERT aligns them; English to German is better than English to Greek. We examine multiple setups and show that the similarity matrices for natural languages show weaker relations the further apart two languages are.