pwc-archive/papers-with-abstracts huggingface dataset:
Boosting Entity Mention Detection for Targetted Twitter Streams with Global Contextual Embeddings
Authors: Satadisha Saha Bhowmick, Eduard C. Dragut, Weiyi Meng
Date: 2022-01-28 00:00:00

Microblogging sites, like Twitter, have emerged as ubiquitous sources of information. Two important tasks related to the automatic extraction and analysis of information in Microblogs are Entity Mention Detection (EMD) and Entity Detection (ED). The state-of-the-art EMD systems aim to model the non-literary nature of microblog text by training upon offline static datasets. They extract a combination of surface-level features -- orthographic, lexical, and semantic -- from individual messages for noisy text modeling and entity extraction. But given the constantly evolving nature of microblog streams, detecting all entity mentions from such varying yet limited context of short messages remains a difficult problem. To this end, we propose a framework named EMD Globalizer, better suited for the execution of EMD learners on microblog streams. It deviates from the processing of isolated microblog messages by existing EMD systems, where learned knowledge from the immediate context of a message is used to suggest entities. After an initial extraction of entity candidates by an EMD system, the proposed framework leverages occurrence mining to find additional candidate mentions that are missed during this first detection. Aggregating the local contextual representations of these mentions, a global embedding is drawn from the collective context of an entity candidate within a stream. The global embeddings are then utilized to separate entities within the candidates from false positives. All mentions of said entities from the stream are produced in the framework's final outputs. Our experiments show that EMD Globalizer can enhance the effectiveness of all existing EMD systems that we tested (on average by 25.61%) with a small additional computational overhead.
Neural-FST Class Language Model for End-to-End Speech Recognition
Authors: Antoine Bruguier, Duc Le, Rohit Prabhavalkar, Dangna Li, Zhe Liu, Bo wang, Eun Chang, Fuchun Peng, Ozlem Kalinli, Michael L. Seltzer
Date: 2022-01-28 00:00:00
Tasks: Language Modeling, Language Modelling, speech-recognition, Speech Recognition

We propose Neural-FST Class Language Model (NFCLM) for end-to-end speech recognition, a novel method that combines neural network language models (NNLMs) and finite state transducers (FSTs) in a mathematically consistent framework. Our method utilizes a background NNLM which models generic background text together with a collection of domain-specific entities modeled as individual FSTs. Each output token is generated by a mixture of these components; the mixture weights are estimated with a separately trained neural decider. We show that NFCLM significantly outperforms NNLM by 15.8% relative in terms of Word Error Rate. NFCLM achieves similar performance as traditional NNLM and FST shallow fusion while being less prone to overbiasing and 12 times more compact, making it more suitable for on-device usage.
Sentiment-Aware Automatic Speech Recognition pre-training for enhanced Speech Emotion Recognition
Authors: Ayoub Ghriss, Bo Yang, Viktor Rozgic, Elizabeth Shriberg, Chao Wang
Date: 2022-01-27 00:00:00
Tasks: Automatic Speech Recognition, Automatic Speech Recognition (ASR), Classification, Emotion Recognition, Sentiment Analysis, Sentiment Classification, Speech Emotion Recognition, speech-recognition, Speech Recognition

We propose a novel multi-task pre-training method for Speech Emotion Recognition (SER). We pre-train SER model simultaneously on Automatic Speech Recognition (ASR) and sentiment classification tasks to make the acoustic ASR model more ``emotion aware''. We generate targets for the sentiment classification using text-to-sentiment model trained on publicly available data. Finally, we fine-tune the acoustic ASR on emotion annotated speech data. We evaluated the proposed approach on the MSP-Podcast dataset, where we achieved the best reported concordance correlation coefficient (CCC) of 0.41 for valence prediction.
Going Extreme: Comparative Analysis of Hate Speech in Parler and Gab
Authors: Abraham Israeli, Oren Tsur
Date: 2022-01-27 00:00:00
Tasks: Hate Speech Detection, Transfer Learning

Social platforms such as Gab and Parler, branded as `free-speech' networks, have seen a significant growth of their user base in recent years. This popularity is mainly attributed to the stricter moderation enforced by mainstream platforms such as Twitter, Facebook, and Reddit. In this work we provide the first large scale analysis of hate-speech on Parler. We experiment with an array of algorithms for hate-speech detection, demonstrating limitations of transfer learning in that domain, given the illusive and ever changing nature of the ways hate-speech is delivered. In order to improve classification accuracy we annotated 10K Parler posts, which we use to fine-tune a BERT classifier. Classification of individual posts is then leveraged for the classification of millions of users via label propagation over the social network. Classifying users by their propensity to disseminate hate, we find that hate mongers make 16.1\% of Parler active users, and that they have distinct characteristics comparing to other user groups. We find that hate mongers are more active, more central and express distinct levels of sentiment and convey a distinct array of emotions like anger and sadness. We further complement our analysis by comparing the trends discovered in Parler and those found in Gab. To the best of our knowledge, this is among the first works to analyze hate speech in Parler in a quantitative manner and on the user level, and the first annotated dataset to be made available to the community.
Stagnation Detection Meets Fast Mutation
Authors: Benjamin Doerr, Amirhossein Rajabi
Date: 2022-01-28 00:00:00

Two mechanisms have recently been proposed that can significantly speed up finding distant improving solutions via mutation, namely using a random mutation rate drawn from a heavy-tailed distribution ("fast mutation", Doerr et al. (2017)) and increasing the mutation strength based on stagnation detection (Rajabi and Witt (2020)). Whereas the latter can obtain the asymptotically best probability of finding a single desired solution in a given distance, the former is more robust and performs much better when many improving solutions in some distance exist. In this work, we propose a mutation strategy that combines ideas of both mechanisms. We show that it can also obtain the best possible probability of finding a single distant solution. However, when several improving solutions exist, it can outperform both the stagnation-detection approach and fast mutation. The new operator is more than an interleaving of the two previous mechanisms and it also outperforms any such interleaving.
A neural net architecture based on principles of neural plasticity and development evolves to effectively catch prey in a simulated environment
Authors: Addison Wood, Jory Schossau, Nick Sabaj, Richard Liu, Mark Reimers
Date: 2022-01-28 00:00:00
Tasks: Continual Learning

A profound challenge for A-Life is to construct agents whose behavior is 'life-like' in a deep way. We propose an architecture and approach to constructing networks driving artificial agents, using processes analogous to the processes that construct and sculpt the brains of animals. Furthermore the instantiation of action is dynamic: the whole network responds in real-time to sensory inputs to activate effectors, rather than computing a representation of the optimal behavior and sending off an encoded representation to effector controllers. There are many parameters and we use an evolutionary algorithm to select them, in the context of a specific prey-capture task. We think this architecture may be useful for controlling small autonomous robots or drones, because it allows for a rapid response to changes in sensor inputs.
Multi-objective learner performance-based behavior algorithm with five multi-objective real-world engineering problems
Authors: Chnoor M. Rahman, Tarik A. Rashid, Aram Mahmood Ahmed, Seyedali Mirjalili
Date: 2022-01-15 00:00:00
Tasks: Descriptive, Multiobjective Optimization

In this work, a new multiobjective optimization algorithm called multiobjective learner performance-based behavior algorithm is proposed. The proposed algorithm is based on the process of transferring students from high school to college. The proposed technique produces a set of non-dominated solutions. To judge the ability and efficacy of the proposed multiobjective algorithm, it is evaluated against a group of benchmarks and five real-world engineering optimization problems. Additionally, to evaluate the proposed technique quantitatively, several most widely used metrics are applied. Moreover, the results are confirmed statistically. The proposed work is then compared with three multiobjective algorithms, which are MOWCA, NSGA-II, and MODA. Similar to the proposed technique, the other algorithms in the literature were run against the benchmarks, and the real-world engineering problems utilized in the paper. The algorithms are compared with each other employing descriptive, tabular, and graphical demonstrations. The results proved the ability of the proposed work in providing a set of non-dominated solutions, and that the algorithm outperformed the other participated algorithms in most of the cases.
Increasing the skill of short-term wind speed ensemble forecasts combining forecasts and observations via a new dynamic calibration
Authors: Gabriele Casciaro, Francesco Ferrari, Daniele Lagomarsino Oneto, Andrea Lira-Loarca, Andrea Mazzino
Date: 2022-01-28 00:00:00

All numerical weather prediction models used for the wind industry need to produce their forecasts starting from the main synoptic hours 00, 06, 12, and 18 UTC, once the analysis becomes available. The six-hour latency time between two consecutive model runs calls for strategies to fill the gap by providing new accurate predictions having, at least, hourly frequency. This is done to accommodate the request of frequent, accurate and fresh information from traders and system regulators to continuously adapt their work strategies. Here, we propose a strategy where quasi-real time observed wind speed and weather model predictions are combined by means of a novel Ensemble Model Output Statistics (EMOS) strategy. The success of our strategy is measured by comparisons against observed wind speed from SYNOP stations over Italy in the years 2018 and 2019.
Reducing COVID-19 Cases and Deaths by Applying Blockchain in Vaccination Rollout Management
Authors: Jorge Medina, Roberto Rojas-Cessa, Vatcharapan Umpaichitra
Date: 2022-01-27 00:00:00
Tasks: Management

Because a fast vaccination rollout against coronavirus disease 2019 (COVID-19) is critical to restore daily life and avoid virus mutations, it is tempting to have a relaxed vaccination-administration management system. However, a robust management system can support the enforcement of preventive measures, and in turn, reduce incidence and deaths. Here, we model a trustable and reliable management system based on blockchain for vaccine distribution by extending the Susceptible-Exposed-Infected-Recovery (SEIR) model. The model includes prevention measures such as mask-wearing, social distance, vaccination rate, and vaccination efficiency. It also considers negative social behavior, such as violations of social distance and attempts of using illegitimate vaccination proofs. By evaluating the model, we show that the proposed system can reduce up to 2.5 million cases and half a million deaths in the most demanding scenarios.
Outage performance analysis of RIS-assisted UAV wireless systems under disorientation and misalignment
Authors: Alexandros-Apostolos A. Boulogeorgos, Angeliki Alexiou, Marco Di Renzo
Date: 2022-01-28 00:00:00
Tasks: Diversity, Form

In this paper, we analyze the performance of a reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicle (UAV) wireless system that is affected by mixture-gamma small-scale fading, stochastic disorientation, and misalignment, as well as transceivers hardware imperfections. First, we statistically characterize the end-to-end channel for both cases, i.e., in the absence as well as in the presence of disorientation and misalignment, by extracting closed-form formulas for the probability density function (PDF) and the cumulative distribution function (CDF). Building on the aforementioned expressions, we extract novel closed-form expressions for the outage probability (OP) in the absence and the presence of disorientation and misalignment as well as hardware imperfections. In addition, high signal-to-noise ratio OP approximations are derived, leading to the extraction of the diversity order. Finally, an OP floor due to disorientation and misalignment is presented.
Inertial Navigation Using an Inertial Sensor Array
Authors: Håkan Carlsson, Isaac Skog, Gustaf Hendeby, Joakim Jaldén
Date: 2022-01-28 00:00:00
Tasks: Numerical Integration, State Space Models

We present a comprehensive framework for fusing measurements from multiple and generally placed accelerometers and gyroscopes to perform inertial navigation. Using the angular acceleration provided by the accelerometer array, we show that the numerical integration of the orientation can be done with second-order accuracy, which is more accurate compared to the traditional first-order accuracy that can be achieved when only using the gyroscopes. Since orientation errors are the most significant error source in inertial navigation, improving the orientation estimation reduces the overall navigation error. The practical performance benefit depends on prior knowledge of the inertial sensor array, and therefore we present four different state-space models using different underlying assumptions regarding the orientation modeling. The models are evaluated using a Lie Group Extended Kalman filter through simulations and real-world experiments. We also show how individual accelerometer biases are unobservable and can be replaced by a six-dimensional bias term whose dimension is fixed and independent of the number of accelerometers.
Global-Reasoned Multi-Task Learning Model for Surgical Scene Understanding
Authors: Lalithkumar Seenivasan, Sai Mitheran, Mobarakol Islam, Hongliang Ren
Date: 2022-01-28 00:00:00
Tasks: Graph Attention, Knowledge Distillation, Multi-Task Learning, Relational Reasoning, Scene Understanding, Segmentation, Semantic Segmentation

Global and local relational reasoning enable scene understanding models to perform human-like scene analysis and understanding. Scene understanding enables better semantic segmentation and object-to-object interaction detection. In the medical domain, a robust surgical scene understanding model allows the automation of surgical skill evaluation, real-time monitoring of surgeon's performance and post-surgical analysis. This paper introduces a globally-reasoned multi-task surgical scene understanding model capable of performing instrument segmentation and tool-tissue interaction detection. Here, we incorporate global relational reasoning in the latent interaction space and introduce multi-scale local (neighborhood) reasoning in the coordinate space to improve segmentation. Utilizing the multi-task model setup, the performance of the visual-semantic graph attention network in interaction detection is further enhanced through global reasoning. The global interaction space features from the segmentation module are introduced into the graph network, allowing it to detect interactions based on both node-to-node and global interaction reasoning. Our model reduces the computation cost compared to running two independent single-task models by sharing common modules, which is indispensable for practical applications. Using a sequential optimization technique, the proposed multi-task model outperforms other state-of-the-art single-task models on the MICCAI endoscopic vision challenge 2018 dataset. Additionally, we also observe the performance of the multi-task model when trained using the knowledge distillation technique. The official code implementation is made available in GitHub.
Low-Cost Inertial Aiding for Deep-Urban Tightly-Coupled Multi-Antenna Precise GNSS
Authors: James E. Yoder, Todd E. Humphreys
Date: 2022-01-27 00:00:00
Tasks: Pose Estimation

A vehicular pose estimation technique is presented that tightly couples multi-antenna carrier-phase differential GNSS (CDGNSS) with a low-cost MEMS inertial sensor and vehicle dynamics constraints. This work is the first to explore the use of consumer-grade inertial sensors for tightly-coupled urban CDGNSS, and first to explore the tightly-coupled combination of multi-antenna CDGNSS and inertial sensing (of any quality) for urban navigation. An unscented linearization permits ambiguity resolution using traditional integer least squares while both implicitly enforcing known-baseline-length constraints and exploiting the multi-baseline problem's inter-baseline correlations. A novel false fix detection and recovery technique is developed to mitigate the effect of conditioning the filter state on incorrect integers. When evaluated on the publicly-available TEX-CUP urban positioning dataset, the proposed technique achieves, with consumer- and industrial-grade inertial sensors, respectively, a 96.6% and 97.5% integer fix availability, and 12.0 cm and 10.1 cm overall (fix and float) 95th percentile horizontal positioning error.
Quantitative Resilience of Linear Systems
Authors: Jean-Baptiste Bouvier, Melkior Ornik
Date: 2022-01-28 00:00:00

Actuator malfunctions may have disastrous consequences for systems not designed to mitigate them. We focus on the loss of control authority over actuators, where some actuators are uncontrolled but remain fully capable. To counteract the undesirable outputs of these malfunctioning actuators, we use real-time measurements and redundant actuators. In this setting, a system that can still reach its target is deemed resilient. To quantify the resilience of a system, we compare the shortest time for the undamaged system to reach the target with the worst-case shortest time for the malfunctioning system to reach the same target, i.e., when the malfunction makes that time the longest. Contrary to prior work on driftless linear systems, the absence of analytical expression for time-optimal controls of general linear systems prevents an exact calculation of quantitative resilience. Instead, relying on Lyapunov theory we derive analytical bounds on the nominal and malfunctioning reach times in order to bound quantitative resilience. We illustrate our work on a temperature control system.
Data-Driven Modeling of Aggregate Flexibility under Uncertain and Non-Convex Load Models
Authors: Sina Taheri, Vassilis Kekatos, Harsha Veeramachaneni, Baosen Zhang
Date: 2022-01-28 00:00:00
Tasks: LEMMA, Scheduling

Bundling a large number of distributed energy resources through a load aggregator has been advocated as an effective means to integrate such resources into whole-sale energy markets. To ease market clearing, system operators allow aggregators to submit bidding models of simple prespecified polytopic shapes. Aggregators need to carefully design and commit to a polytope that best captures their energy flexibility along a day-ahead scheduling horizon. This work puts forth a model-informed data-based optimal flexibility design for aggregators, which deals with the time-coupled, uncertain, and non-convex models of individual loads. The proposed solution first generates efficiently a labeled dataset of (non)-disaggregatable schedules. The feasible set of the aggregator is then approximated by an ellipsoid upon training a convex quadratic classifier using the labeled dataset. The ellipsoid is subsequently inner approximated by a polytope. Using Farkas lemma, the obtained polytope is finally inner approximated by the polytopic shape dictated by the market. Numerical tests show the effectiveness of the proposed flexibility design framework for designing the feasible sets of small- and large-sized aggregators coordinating solar photovoltaics, thermostatically-controlled loads, batteries, and electric vehicles. The tests further demonstrate that it is crucial for the aggregator to consider time-coupling and uncertainties in optimal flexibility design.
Coupled power generators require stability buffers in addition to inertia
Authors: Gurupraanesh Raman, Gururaghav Raman, Jimmy Chih-Hsien Peng
Date: 2022-01-28 00:00:00

Increasing the inertia is widely considered to be the solution to resolving unstable interactions between coupled oscillators. In power grids, Virtual Synchronous Generators (VSGs) are proposed to compensate the reducing inertia as rotating synchronous generators are being phased out. Yet, modeling how VSGs and rotating generators simultaneously contribute energy and inertia, we surprisingly find that instabilities of a small-signal nature could arise despite fairly high system inertia. Importantly, we show there exist both an optimal and a maximum number of such VSGs that can be safely supported, a previously unknown result directly useful for power utilities in long-term planning and prosumer contracting. Meanwhile, to resolve instabilities in the short term, we argue that the new market should include another commodity that we call stability storage, whereby -- analogous to energy storage buffering energy imbalances -- VSGs act as decentralized stability buffers. While demonstrating the effectiveness of this concept for a wide range of energy futures, we provide policymakers and utilities with a roadmap towards achieving a 100% renewable grid.
Distributed Stochastic Model Predictive Control for Human-Leading Heavy-Duty Truck Platoon
Authors: Mehmet Fatih Ozkan, Yao Ma
Date: 2022-01-27 00:00:00
Tasks: Model Predictive Control

Human-leading truck platooning systems have been proposed to leverage the benefits of both human supervision and vehicle autonomy. Equipped with human guidance and autonomous technology, human-leading truck platooning systems are more versatile to handle uncertain traffic conditions than fully automated platooning systems. This paper presents a novel distributed stochastic model predictive control (DSMPC) design for a human-leading heavy-duty truck platoon. The proposed DSMPC design integrates the stochastic driver behavior model of the human-driven leader truck with a distributed formation control design for the following automated trucks in the platoon. The driver behavior of the human-driven leader truck is learned by a stochastic inverse reinforcement learning (SIRL) approach. The proposed stochastic driver behavior model aims to learn a distribution of cost function, which represents the richness and uniqueness of human driver behaviors, with a given set of driver-specific demonstrations. The distributed formation control includes a serial DSMPC with guaranteed recursive feasibility, closed-loop chance constraint satisfaction, and string stability. Simulation studies are conducted to investigate the efficacy of the proposed design under several realistic traffic scenarios. Compared to the baseline platoon control strategy (deterministic distributed model predictive control), the proposed DSMPC achieves superior controller performance in constraint violations and spacing errors.