pwc-archive/papers-with-abstracts huggingface dataset:
COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization
Authors: Chenxin An, Ming Zhong, Zhiyong Wu, Qin Zhu, Xuanjing Huang, Xipeng Qiu
Date: 2022-09-29 00:00:00
Proceeding: COLING 2022 10
Tasks: Abstractive Text Summarization, Contrastive Learning, GPU, Re-Ranking, Sentence

Traditional training paradigms for extractive and abstractive summarization systems always only use token-level or sentence-level training objectives. However, the output summary is always evaluated from summary-level which leads to the inconsistency in training and evaluation. In this paper, we propose a Contrastive Learning based re-ranking framework for one-stage summarization called COLO. By modeling a contrastive objective, we show that the summarization model is able to directly generate summaries according to the summary-level score without additional modules and parameters. Extensive experiments demonstrate that COLO boosts the extractive and abstractive results of one-stage systems on CNN/DailyMail benchmark to 44.58 and 46.33 ROUGE-1 score while preserving the parameter efficiency and inference efficiency. Compared with state-of-the-art multi-stage systems, we save more than 100 GPU training hours and obtaining 3~8 speed-up ratio during inference while maintaining comparable results.
Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By Experts
Authors: Timo Spinde, Manuel Plank, Jan-David Krieger, Terry Ruas, Bela Gipp, Akiko Aizawa
Date: 2022-09-29 00:00:00
Tasks: Articles, Bias Detection, Sentence

Media coverage has a substantial effect on the public perception of events. Nevertheless, media outlets are often biased. One way to bias news articles is by altering the word choice. The automatic identification of bias by word choice is challenging, primarily due to the lack of a gold standard data set and high context dependencies. This paper presents BABE, a robust and diverse data set created by trained experts, for media bias research. We also analyze why expert labeling is essential within this domain. Our data set offers better annotation quality and higher inter-annotator agreement than existing work. It consists of 3,700 sentences balanced among topics and outlets, containing media bias labels on the word and sentence level. Based on our data, we also introduce a way to detect bias-inducing sentences in news articles automatically. Our best performing BERT-based model is pre-trained on a larger corpus consisting of distant labels. Fine-tuning and evaluating the model on our proposed supervised data set, we achieve a macro F1-score of 0.804, outperforming existing methods.
Multi-stage Information Retrieval for Vietnamese Legal Texts
Authors: Nhat-Minh Pham, Ha-Thanh Nguyen, Trong-Hop Do
Date: 2022-09-29 00:00:00
Tasks: Information Retrieval, Retrieval, Sentence

This study deals with the problem of information retrieval (IR) for Vietnamese legal texts. Despite being well researched in many languages, information retrieval has still not received much attention from the Vietnamese research community. This is especially true for the case of legal documents, which are hard to process. This study proposes a new approach for information retrieval for Vietnamese legal documents using sentence-transformer. Besides, various experiments are conducted to make comparisons between different transformer models, ranking scores, syllable-level, and word-level training. The experiment results show that the proposed model outperforms models used in current research on information retrieval for Vietnamese documents.
Improving Text-to-SQL Semantic Parsing with Fine-grained Query Understanding
Authors: Jun Wang, Patrick Ng, Alexander Hanbo Li, Jiarong Jiang, Zhiguo Wang, Ramesh Nallapati, Bing Xiang, Sudipta Sengupta
Date: 2022-09-28 00:00:00
Tasks: NER, Semantic Parsing, Text to SQL, Text-To-SQL

Most recent research on Text-to-SQL semantic parsing relies on either parser itself or simple heuristic based approach to understand natural language query (NLQ). When synthesizing a SQL query, there is no explicit semantic information of NLQ available to the parser which leads to undesirable generalization performance. In addition, without lexical-level fine-grained query understanding, linking between query and database can only rely on fuzzy string match which leads to suboptimal performance in real applications. In view of this, in this paper we present a general-purpose, modular neural semantic parsing framework that is based on token-level fine-grained query understanding. Our framework consists of three modules: named entity recognizer (NER), neural entity linker (NEL) and neural semantic parser (NSP). By jointly modeling query and database, NER model analyzes user intents and identifies entities in the query. NEL model links typed entities to schema and cell values in database. Parser model leverages available semantic information and linking results and synthesizes tree-structured SQL queries based on dynamically generated grammar. Experiments on SQUALL, a newly released semantic parsing dataset, show that we can achieve 56.8% execution accuracy on WikiTableQuestions (WTQ) test set, which outperforms the state-of-the-art model by 2.7%.
Clinical Language Understanding Evaluation (CLUE)
Authors: Travis R. Goodwin, Dina Demner-Fushman
Date: 2022-09-28 00:00:00
Tasks: Mortality Prediction

Clinical language processing has received a lot of attention in recent years, resulting in new models or methods for disease phenotyping, mortality prediction, and other tasks. Unfortunately, many of these approaches are tested under different experimental settings (e.g., data sources, training and testing splits, metrics, evaluation criteria, etc.) making it difficult to compare approaches and determine state-of-the-art. To address these issues and facilitate reproducibility and comparison, we present the Clinical Language Understanding Evaluation (CLUE) benchmark with a set of four clinical language understanding tasks, standard training, development, validation and testing sets derived from MIMIC data, as well as a software toolkit. It is our hope that these data will enable direct comparison between approaches, improve reproducibility, and reduce the barrier-to-entry for developing novel models or methods for these clinical language understanding tasks.
Happy or grumpy? A Machine Learning Approach to Analyze the Sentiment of Airline Passengers' Tweets
Authors: Shengyang Wu, Yi Gao
Date: 2022-09-28 00:00:00
Tasks: Lexical Analysis, Sentiment Analysis, Time Series, Time Series Analysis

As one of the most extensive social networking services, Twitter has more than 300 million active users as of 2022. Among its many functions, Twitter is now one of the go-to platforms for consumers to share their opinions about products or experiences, including flight services provided by commercial airlines. This study aims to measure customer satisfaction by analyzing sentiments of Tweets that mention airlines using a machine learning approach. Relevant Tweets are retrieved from Twitter's API and processed through tokenization and vectorization. After that, these processed vectors are passed into a pre-trained machine learning classifier to predict the sentiments. In addition to sentiment analysis, we also perform lexical analysis on the collected Tweets to model keywords' frequencies, which provide meaningful contexts to facilitate the interpretation of sentiments. We then apply time series methods such as Bollinger Bands to detect abnormalities in sentiment data. Using historical records from January to July 2022, our approach is proven to be capable of capturing sudden and significant changes in passengers' sentiment. This study has the potential to be developed into an application that can help airlines, along with several other customer-facing businesses, efficiently detect abrupt changes in customers' sentiments and take adequate measures to counteract them.
Who is GPT-3? An Exploration of Personality, Values and Demographics
Authors: Marilù Miotto, Nicola Rossberg, Bennett Kleinberg
Date: 2022-09-28 00:00:00
Tasks: Language Modeling, Language Modelling

Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa.
Scaling transformation of the multimode nonlinear Schrödinger equation for physics-informed neural networks
Authors: Ivan Chuprov, Dmitry Efremenko, Jiexing Gao, Pavel Anisimov, Viacheslav Zemlyakov
Date: 2022-09-29 00:00:00

Single-mode optical fibers (SMFs) have become the backbone of modern communication systems. However, their throughput is expected to reach its theoretical limit in the nearest future. Utilization of multimode fibers (MMFs) is considered as one of the most promising solutions rectifying this capacity crunch. Nevertheless, differential equations describing light propagation in MMFs are a way more sophisticated than those for SMFs, which makes numerical modelling of MMF-based systems computationally demanding and impractical for the most part of realistic scenarios. Physics-informed neural networks (PINNs) are known to outperform conventional numerical approaches in various domains and have been successfully applied to the nonlinear Schr\"odinger equation (NLSE) describing light propagation in SMFs. A comprehensive study on application of PINN to the multimode NLSE (MMNLSE) is still lacking though. To the best of our knowledge, this paper is the first to deploy the paradigm of PINN for MMNLSE and to demonstrate that a straightforward implementation of PINNs by analogy with NLSE does not work out. We pinpoint all issues hindering PINN convergence and introduce a novel scaling transformation for the zero-order dispersion coefficient that makes PINN capture all relevant physical effects. Our simulations reveal good agreement with the split-step Fourier (SSF) method and extend numerically attainable propagation lengths up to several hundred meters. All major limitations are also highlighted.
Exact Recovery of Community Detection in dependent Gaussian Mixture Models
Authors: Zhongyang Li, Sichen Yang
Date: 2022-09-23 00:00:00
Tasks: Community Detection

We study the community detection problem on a Gaussian mixture model, in which (1) vertices are divided into $k\geq 2$ distinct communities that are not necessarily equally-sized; (2) the Gaussian perturbations for different entries in the observation matrix are not necessarily independent or identically distributed. We prove necessary and sufficient conditions for the exact recovery of the maximum likelihood estimation (MLE), and discuss the cases when these necessary and sufficient conditions give sharp threshold. Applications include the community detection on a graph where the Gaussian perturbations of observations on each edge is the sum of i.i.d.~Gaussian random variables on its end vertices, in which we explicitly obtain the threshold for the exact recovery of the MLE.
Optimal Stopping with Gaussian Processes
Authors: Kshama Dwarakanath, Danial Dervovic, Peyman Tavallali, Svitlana S Vyetrenko, Tucker Balch
Date: 2022-09-22 00:00:00
Tasks: Gaussian Processes, Time Series, Time Series Analysis

We propose a novel group of Gaussian Process based algorithms for fast approximate optimal stopping of time series with specific applications to financial markets. We show that structural properties commonly exhibited by financial time series (e.g., the tendency to mean-revert) allow the use of Gaussian and Deep Gaussian Process models that further enable us to analytically evaluate optimal stopping value functions and policies. We additionally quantify uncertainty in the value function by propagating the price model through the optimal stopping analysis. We compare and contrast our proposed methods against a sampling-based method, as well as a deep learning based benchmark that is currently considered the state-of-the-art in the literature. We show that our family of algorithms outperforms benchmarks on three historical time series datasets that include intra-day and end-of-day equity stock prices as well as the daily US treasury yield curve rates.
Evaluating Research Dataset Recommendations in a Living Lab
Authors: Jüri Keller, Leon Paul Mondrian Munz
Date: 2022-09-29 00:00:00
Tasks: Retrieval

The search for research datasets is as important as laborious. Due to the importance of the choice of research data in further research, this decision must be made carefully. Additionally, because of the growing amounts of data in almost all areas, research data is already a central artifact in empirical sciences. Consequentially, research dataset recommendations can beneficially supplement scientific publication searches. We formulated the recommendation task as a retrieval problem by focussing on broad similarities between research datasets and scientific publications. In a multistage approach, initial recommendations were retrieved by the BM25 ranking function and dynamic queries. Subsequently, the initial ranking was re-ranked utilizing click feedback and document embeddings. The proposed system was evaluated live on real user interaction data using the STELLA infrastructure in the LiLAS Lab at CLEF 2021. Our experimental system could efficiently be fine-tuned before the live evaluation by pre-testing the system with a pseudo test collection based on prior user interaction data from the live system. The results indicate that the experimental system outperforms the other participating systems.
The Role of Metadata in Non-Fungible Tokens: Marketplace Analysis and Collection Organization
Authors: Sarah Barrington
Date: 2022-09-28 00:00:00

An explosion of interest in Non-Fungible Tokens (NFTs) has led to the emergence of vibrant online marketplaces that enable users to buy, sell and create digital assets. Largely considered contractual representations of digital artworks, NFTs allow ownership and authenticity to be proven through storing an asset and its associated metadata on a Blockchain. Yet, variation exists between chains, token protocols (such as the ERC-721 NFT standard) and marketplaces, leading to inconsistencies in the definitions and roles of token metadata. This research thus aims to define metadata in the context of NFTs, explore the boundary of metadata and asset data within tokens, and understand the variances and impacts these structures have on the curation of NFTs within online marketplaces and collections.
Transmission Model for Resonant Beam SWIPT with Telescope Internal Modulator
Authors: Wen Fang, Yunfeng Bai, Qingwen Liu, Shengli Zhou
Date: 2022-09-29 00:00:00

To satisfy the long-range and energy self-sustaining communication needs of electronic devices in the Internet of Things (IoT), we introduce a simultaneous wireless information and power transfer (SWIPT) system using the resonant beam that incorporates a telescope modulator inside a cavity for suppressing diffraction losses. We theoretically analyze power transfer in the resonant beam system with telescope internal modulator (TIM-RBS) considering the electromagnetic field propagation, the end-to-end (E2E) power transfer, and power and information reception. The numerical evaluation demonstrates that the TIM can effectively compress the beam spot, which allows the TIM-RBS to transmit energy twice as far as the RBS without TIM at higher power. Additionally, the largest transmission distance and maximum output power are proportional to the input power, and about 34m transmission distance, 4W electric power, and 12bps/Hz spectral efficiency can be achieved in the TIM-RBS with 200W input power. Hence, TIM-RBS can be considered as a promising option for realizing long-range, high-power, and high-rate SWIPT.
Attention to Fires: Multi-Channel Deep Learning Models for Wildfire Severity Prediction
Authors: Simone Monaco, Salvatore Greco, Alessandro Farasin, Luca Colomba, Daniele Apiletti, Paolo Garza, Tania Cerquitelli, Elena Baralis
Date: 2021-11-22 00:00:00
Proceeding: Applied Sciences 2021 11
Tasks: Burned Area Delineation, Decision Making, Earth Observation, severity prediction

Wildﬁres are one of the natural hazards that the European Union is actively monitoring through the Copernicus EMS Earth observation program which continuously releases public information related to such catastrophic events. Such occurrences are the cause of both short- and long-term damages. Thus, to limit their impact and plan the restoration process, a rapid intervention by authorities is needed, which can be enhanced by the use of satellite imagery and automatic burned area delineation methodologies, accelerating the response and the decision-making processes. In this context, we analyze the burned area severity estimation problem by exploiting a state-of-the-art deep learning framework. Experimental results compare different model architectures and loss functions on a very large real-world Sentinel2 satellite dataset. Furthermore, a novel multi-channel attentionbased analysis is presented to uncover the prediction behaviour and provide model interpretability. A perturbation mechanism is applied to an attention-based DS-UNet to evaluate the contribution of different domain-driven groups of channels to the severity estimation problem.
Backflipping with Miniature Quadcopters by Gaussian Process Based Control and Planning
Authors: Péter Antal, Tamás Péni, Roland Tóth
Date: 2022-09-29 00:00:00
Tasks: Bayesian Optimization, Trajectory Planning

The paper proposes two control methods for performing a backflip maneuver with miniature quadcopters. First, an existing feedforward control approach is improved by finding the optimal sequence of motion primitives via Bayesian optimization, using a surrogate Gaussian Process model. To evaluate the cost function, the flip maneuver is performed repeatedly in a simulation environment. The second method is based on closed-loop control and it consists of two main steps: first a novel robust, adaptive controller is designed to provide reliable reference tracking even in case of model uncertainties. The controller is constructed by augmenting the nominal model of the drone with a Gaussian Process that is trained by using measurement data. Second, an efficient trajectory planning algorithm is proposed, which designs feasible trajectories for the flip maneuver by using only quadratic programming. The two approaches are analyzed in simulations and in real experiments using Bitcraze Crazyflie 2.1 quadcopters.
Text Independent Speaker Identification System for Access Control
Authors: Oluyemi E. Adetoyi
Date: 2022-09-26 00:00:00
Tasks: Speaker Identification

Even human intelligence system fails to offer 100% accuracy in identifying speeches from a specific individual. Machine intelligence is trying to mimic humans in speaker identification problems through various approaches to speech feature extraction and speech modeling techniques. This paper presents a text-independent speaker identification system that employs Mel Frequency Cepstral Coefficients (MFCC) for feature extraction and k-Nearest Neighbor (kNN) for classification. The maximum cross-validation accuracy obtained was 60%. This will be improved upon in subsequent research.
Distributed decentralized receding horizon control for very large-scale networks with application to satellite mega-constellations
Authors: Leonardo Pedroso, Pedro Batista
Date: 2022-09-29 00:00:00

The implementation feasibility of control algorithms over very large-scale networks calls for hard constraints regarding communication, computational, and memory requirements. In this paper, the decentralized receding horizon control problem for very large-scale networks of dynamically decoupled systems with a common, possibly time-varying, control objective is addressed. Each system is assumed to be modeled by linear time-varying dynamics, which can be leveraged to approximate nonlinear systems about successive points of operation. A distributed and decentralized receding horizon control solution is put forward, which: i) takes communication delays into account; ii) allows local communication exclusively; and iii) whose computational and memory requirements in each computational unit do not scale with the dimension of the network. The scalability of the proposed solution enables emerging very large-scale applications of swarm robotics and networked control. This approach is applied to the orbit control problem of low Earth orbit mega-constellations, featuring high-fidelity numerical simulations for the Starlink mega-constellation.
An Economic Model Predictive Control Approach for Load Mitigation on Multiple Tower Locations of Wind Turbines
Authors: Zhixin Feng, Alexander J. Gallo, Yichao Liu, Atindriyo K. Pamososuryo, Riccardo M. G. Ferrari, Jan-Willem van Wingerden
Date: 2022-09-29 00:00:00
Tasks: Model Predictive Control

The current trend in the evolution of wind turbines is to increase their rotor size in order to capture more power. This leads to taller, slender and more flexible towers, which thus experience higher dynamical loads due to the turbine rotation and environmental factors. It is hence compelling to deploy advanced control methods that can dynamically counteract such loads, especially at tower positions that are more prone to develop cracks or corrosion damages. Still, to the best of the authors' knowledge, little to no attention has been paid in the literature to load mitigation at multiple tower locations. Furthermore, there is a need for control schemes that can balance load reduction with optimization of power production. In this paper, we develop an Economic Model Predictive Control (eMPC) framework to address such needs. First, we develop a linear modal model to account for the tower flexural dynamics. Then we incorporate it into an eMPC framework, where the dynamics of the turbine rotation are expressed in energy terms. This allows us to obtain a convex formulation, that is computationally attractive. Our control law is designed to avoid the 'turn-pike' behavior and guarantee recursive feasibility. We demonstrate the performance of the proposed controller on a 5MW reference WT model: the results illustrate that the proposed controller is able to reduce the tower loads at multiple locations, without significant effects to the generated power.