pwc-archive/papers-with-abstracts huggingface dataset:
Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing
Authors: Hao Zhou, Melike Erol-Kantarci, Vincent Poor
Date: 2021-09-16 00:00:00
Tasks: Fairness, Management, Q-Learning, reinforcement-learning, Reinforcement Learning, Reinforcement Learning (RL), Transfer Learning, Transfer Reinforcement Learning

Network slicing is a critical technique for 5G communications that covers radio access network (RAN), edge, transport and core slicing.The evolving network architecture requires the orchestration of multiple network resources such as radio and cache resources. In recent years, machine learning (ML) techniques have been widely applied for network management. However, most existing works do not take advantage of the knowledge transfer capability in ML. In this paper, we propose a deep transfer reinforcement learning (DTRL) scheme for joint radio and cache resource allocation to serve 5G RAN slicing. We first define a hierarchical architecture for joint resource allocation. Then we propose two DTRL algorithms: Q-value-based deep transfer reinforcement learning (QDTRL) and action selection-based deep transfer reinforcement learning (ADTRL). In the proposed schemes, learner agents utilize expert agents' knowledge to improve their performance on current tasks. The proposed algorithms are compared with both the model-free exploration bonus deep Q-learning (EB-DQN) and the model-based priority proportional fairness and time-to-live (PPF-TTL) algorithms. Compared with EB-DQN, our proposed DTRL-based method presents 21.4% lower delay for Ultra Reliable Low Latency Communications (URLLC) slice and 22.4% higher throughput for enhanced Mobile Broad Band (eMBB) slice, while achieving significantly faster convergence than EB-DQN. Moreover, 40.8% lower URLLC delay and 59.8% higher eMBB throughput are observed with respect to PPF-TTL.
NORESQA: A Framework for Speech Quality Assessment using Non-Matching References
Authors: Pranay Manocha, Buye Xu, Anurag Kumar
Date: 2021-09-16 00:00:00
Proceeding: NeurIPS 2021 12
Tasks: Speech Enhancement

The perceptual task of speech quality assessment (SQA) is a challenging task for machines to do. Objective SQA methods that rely on the availability of the corresponding clean reference have been the primary go-to approaches for SQA. Clearly, these methods fail in real-world scenarios where the ground truth clean references are not available. In recent years, non-intrusive methods that train neural networks to predict ratings or scores have attracted much attention, but they suffer from several shortcomings such as lack of robustness, reliance on labeled data for training and so on. In this work, we propose a new direction for speech quality assessment. Inspired by human's innate ability to compare and assess the quality of speech signals even when they have non-matching contents, we propose a novel framework that predicts a subjective relative quality score for the given speech signal with respect to any provided reference without using any subjective data. We show that neural networks trained using our framework produce scores that correlate well with subjective mean opinion scores (MOS) and are also competitive to methods such as DNSMOS, which explicitly relies on MOS from humans for training networks. Moreover, our method also provides a natural way to embed quality-related information in neural networks, which we show is helpful for downstream tasks such as speech enhancement.
PDAugment: Data Augmentation by Pitch and Duration Adjustments for Automatic Lyrics Transcription
Authors: Chen Zhang, Jiaxing Yu, LuChin Chang, Xu Tan, Jiawei Chen, Tao Qin, Kejun Zhang
Date: 2021-09-16 00:00:00
Tasks: Automatic Lyrics Transcription, Automatic Speech Recognition, Automatic Speech Recognition (ASR), Data Augmentation, speech-recognition, Speech Recognition

Automatic lyrics transcription (ALT), which can be regarded as automatic speech recognition (ASR) on singing voice, is an interesting and practical topic in academia and industry. ALT has not been well developed mainly due to the dearth of paired singing voice and lyrics datasets for model training. Considering that there is a large amount of ASR training data, a straightforward method is to leverage ASR data to enhance ALT training. However, the improvement is marginal when training the ALT system directly with ASR data, because of the gap between the singing voice and standard speech data which is rooted in music-specific acoustic characteristics in singing voice. In this paper, we propose PDAugment, a data augmentation method that adjusts pitch and duration of speech at syllable level under the guidance of music scores to help ALT training. Specifically, we adjust the pitch and duration of each syllable in natural speech to those of the corresponding note extracted from music scores, so as to narrow the gap between natural speech and singing voice. Experiments on DSing30 and Dali corpus show that the ALT system equipped with our PDAugment outperforms previous state-of-the-art systems by 5.9% and 18.1% WERs respectively, demonstrating the effectiveness of PDAugment for ALT.
DDS: A new device-degraded speech dataset for speech enhancement
Authors: Haoyu Li, Junichi Yamagishi
Date: 2021-09-16 00:00:00
Tasks: Diversity, Speech Enhancement

A large and growing amount of speech content in real-life scenarios is being recorded on consumer-grade devices in uncontrolled environments, resulting in degraded speech quality. Transforming such low-quality device-degraded speech into high-quality speech is a goal of speech enhancement (SE). This paper introduces a new speech dataset, DDS, to facilitate the research on SE. DDS provides aligned parallel recordings of high-quality speech (recorded in professional studios) and a number of versions of low-quality speech, producing approximately 2,000 hours speech data. The DDS dataset covers 27 realistic recording conditions by combining diverse acoustic environments and microphone devices, and each version of a condition consists of multiple recordings from six microphone positions to simulate different noise and reverberation levels. We also test several SE baseline systems on the DDS dataset and show the impact of recording diversity on performance.
Utterance-level neural confidence measure for end-to-end children speech recognition
Authors: Wei Liu, Tan Lee
Date: 2021-09-16 00:00:00
Tasks: Automatic Speech Recognition, Automatic Speech Recognition (ASR), Binary Classification, speech-recognition, Speech Recognition

Confidence measure is a performance index of particular importance for automatic speech recognition (ASR) systems deployed in real-world scenarios. In the present study, utterance-level neural confidence measure (NCM) in end-to-end automatic speech recognition (E2E ASR) is investigated. The E2E system adopts the joint CTC-attention Transformer architecture. The prediction of NCM is formulated as a task of binary classification, i.e., accept/reject the input utterance, based on a set of predictor features acquired during the ASR decoding process. The investigation is focused on evaluating and comparing the efficacies of predictor features that are derived from different internal and external modules of the E2E system. Experiments are carried out on children speech, for which state-of-the-art ASR systems show less than satisfactory performance and robust confidence measure is particularly useful. It is noted that predictor features related to acoustic information of speech play a more important role in estimating confidence measure than those related to linguistic information. N-best score features show significantly better performance than single-best ones. It has also been shown that the metrics of EER and AUC are not appropriate to evaluate the NCM of a mismatched ASR with significant performance gap.
Stabilization of physical systems via saturated controllers with only partial state measurements
Authors: Pablo Borja, Carmen Chan-Zheng, Jacquelien M. A. Scherpen
Date: 2021-09-16 00:00:00

This paper provides a constructive passivity-based control approach to solve the set-point regulation problem for input-affine continuous nonlinear systems while considering saturation in the inputs. As customarily in passivity-based control, the methodology consists of two steps: energy shaping and damping injection. In terms of applicability, the proposed controllers have two advantages concerning other passivity-based control techniques: (i) the energy shaping is carried out without solving partial differential equations, and (ii) the damping injection is performed without measuring the passive output. The proposed methodology is suitable to control a broad range of physical systems, e.g., mechanical, electrical, and electro-mechanical systems. We illustrate the applicability of the technique by designing controllers for systems in different physical domains, where we validate the analytical results via simulations and experiments.
Deep Learning based Model-free Robust Load Restoration to Enhance Bulk System Resilience with Wind Power Penetration
Authors: Jin Zhao, Fangxing Li, Xi Chen, Qiuwei Wu
Date: 2021-09-16 00:00:00
Tasks: Computational Efficiency

This paper proposes a new deep learning (DL) based model-free robust method for bulk system on-line load restoration with high penetration of wind power. Inspired by the iterative calculation of the two-stage robust load restoration model, the deep neural network (DNN) and deep convolutional neural network (CNN) are respectively designed to find the worst-case system condition of a load pickup decision and evaluate the corresponding security. In order to find the optimal result within a limited number of checks, a load pickup checklist generation (LPCG) algorithm is developed to ensure the optimality. Then, the fast robust load restoration strategy acquisition is achieved based on the designed one-line strategy generation (OSG) algorithm. The proposed method finds the optimal result in a model-free way, holds the robustness to handle uncertainties, and provides real-time computation. It can completely replace conventional robust optimization and supports on-line robust load restoration which better satisfies the changeable restoration process. The effectiveness of the proposed method is validated using the IEEE 30-bus system and the IEEE 118-bus system, showing high computational efficiency and considerable accuracy.
Robust Stability Analysis of an Uncertain Aircraft Model with Scalar Parametric Uncertainty
Authors: Farooq Aslam, Fatima Shoaib, Hafiz Zeeshan Iqbal Khan, Muhammad Farooq Haydar, Jamshed Riaz
Date: 2021-09-16 00:00:00

A robust controller is specified, and the stability bounds of the uncertain closed-loop system are determined using the small gain, circle, positive real, and Popov criteria. A graphical approach is employed in order to demonstrate the ease with which the above robustness tests can be carried out on a problem of practical interest. A significant improvement in stability bounds is observed as the analysis moves from the small gain test to the circle, positive real, and Popov tests. In particular, small gain analysis results in the most conservative robust stability bounds, while Popov analysis yields significantly less conservative bounds. This is because traditional small gain type tests allow the uncertainty to be arbitrarily time-varying, whereas Popov analysis restricts the uncertainty to be constant, real parametric uncertainty. Therefore, the results reported here indicate the conservatism associated with small gain analysis, and the effectiveness of Popov analysis, in gauging robust stability in the presence of constant, real parametric uncertainty.
An extremum seeking algorithm for monotone Nash equilibrium problems
Authors: Suad Krilašević, Sergio Grammatico
Date: 2021-09-16 00:00:00

In this paper we consider the problem of finding a Nash equilibrium (NE) via zeroth-order feedback information in games with merely monotone pseudogradient mapping. Based on hybrid system theory, we propose a novel extremum seeking algorithm which converges to the set of Nash equilibria in a semi-global practical sense. Finally, we present two simulation examples. The first shows that the standard extremum seeking algorithm fails, while ours succeeds in reaching NE. In the second, we simulate an allocation problem with fixed demand.
Basil: A Fast and Byzantine-Resilient Approach for Decentralized Training
Authors: Ahmed Roushdy Elkordy, Saurav Prakash, A. Salman Avestimehr
Date: 2021-09-16 00:00:00

Detection and mitigation of Byzantine behaviors in a decentralized learning setting is a daunting task, especially when the data distribution at the users is heterogeneous. As our main contribution, we propose Basil, a fast and computationally efficient Byzantine robust algorithm for decentralized training systems, which leverages a novel sequential, memory assisted and performance-based criteria for training over a logical ring while filtering the Byzantine users. In the IID dataset distribution setting, we provide the theoretical convergence guarantees of Basil, demonstrating its linear convergence rate. Furthermore, for the IID setting, we experimentally demonstrate that Basil is robust to various Byzantine attacks, including the strong Hidden attack, while providing up to ${\sim}16 \%$ higher test accuracy over the state-of-the-art Byzantine-resilient decentralized learning approach. Additionally, we generalize Basil to the non-IID dataset distribution setting by proposing Anonymous Cyclic Data Sharing (ACDS), a technique that allows each node to anonymously share a random fraction of its local non-sensitive dataset (e.g., landmarks images) with all other nodes. We demonstrate that Basil alongside ACDS with only $5\%$ data sharing provides effective toleration of Byzantine nodes, unlike the state-of-the-art Byzantine robust algorithm that completely fails in the heterogeneous data setting. Finally, to reduce the overall latency of Basil resulting from its sequential implementation over the logical ring, we propose Basil+. In particular, Basil+ provides scalability by enabling Byzantine-robust parallel training across groups of logical rings, and at the same time, it retains the performance gains of Basil due to sequential training within each group. Furthermore, we experimentally demonstrate the scalability gains of Basil+ through different sets of experiments.
Reachability of Linear Uncertain Systems: Sampling Based Approaches
Authors: Bineet Ghosh, Parasara Sridhar Duggirala
Date: 2021-09-16 00:00:00

In this work, we perform safety analysis of linear dynamical systems with uncertainties. Instead of computing a conservative overapproximation of the reachable set, our approach involves computing a statistical approximate reachable set. As a result, the guarantees provided by our method are probabilistic in nature. In this paper, we provide two different techniques to compute statistical approximate reachable set. We have implemented our algorithms in a python based prototype and demonstrate the applicability of our approaches on various case studies. We also provide an empirical comparison between the two proposed methods and with Flow*.
Robustness of Safety for Linear Dynamical Systems: Symbolic and Numerical Approaches
Authors: Bineet Ghosh, Parasara Sridhar Duggirala
Date: 2021-09-16 00:00:00

In this paper, we study the robustness of safety properties of a linear dynamical system with respect to model uncertainties. Our paper involves three parts. In the first part, we provide symbolic (analytical) and numerical (representation based) techniques for computing the reachable set of uncertain linear systems. We further prove a relationship between the reachable set of a linear uncertain system and the maximum singular value of the uncertain dynamics matrix. Finally, we propose two heuristics to compute the robustness threshold of the system -- the maximum uncertainty that can be introduced to the system without violating the safety property. We evaluate the reachable set computation techniques, effects of singular values, and estimation of robustness threshold on two case studies from varied domains, illustrating the applicability, practicality and scalability of the artifacts, proposed in this paper, on real-world examples. We further evaluate our artifacts on several linear dynamical system benchmarks. To the best of the authors' knowledge, this is the first work to: (i) extend perturbation theory to compute reachable sets of linear uncertain systems, (ii) leverage the relationship between the reachable set of a linear system and the maximum singular values to determine the effect of uncertainties and (3) estimate the threshold of robustness that can be tolerated by the system while remaining safe.
Virtual Inertia Control of the Virtual Synchronous Generator: A Review
Authors: Meiyi Li, Wentao Huang, Nengling Tai, Dongliang Duan
Date: 2021-09-15 00:00:00

With the increasing impact of low inertia due to the high penetration of distributed generation, virtual synchronous generator (VSG) technology has been proposed to improve the stability of the inverter-interfaced distributed generator by providing "virtual inertia". This paper presents a recent review of virtual inertia control covering significance, features, design principles, and state-of-art inertia strategies from both physical and mathematical perspectives to facilitate the wide application of the VSG. The definition and source of virtual inertia are given to help researchers to establish the concept of "virtual inertia". Then, this paper covers influencing mechanism studies of virtual inertia to reveal its functions. Also, a design framework of the virtual inertia is established by considering both the characteristics of the control system and the limitation of energy storage systems and renewable energy resources. Finally, several novel adaptive inertia control strategies are reviewed, and some aspects of potential future research are recommended.
Single-camera Two-Wavelength Imaging Pyrometry for Melt Pool Temperature Measurement and Monitoring in Laser Powder Bed Fusion based Additive Manufacturing
Authors: Chaitanya Krishna Prasad Vallabh, Xiayun Zhao
Date: 2021-09-14 00:00:00

Melt pool (MP) temperature is one of the determining factors and key signatures for the properties of printed components during metal additive manufacturing (AM). The state-of-the art measurement systems are hindered by both the equipment cost and the large-scale data acquisition and processing demands. In this work, we introduce a novel coaxial high-speed single-camera two-wavelength imaging pyrometer (STWIP) system as opposed to the typical utilization of multiple cameras for measuring MP temperature profiles through a laser powder bed fusion (LPBF) process. Developed on a commercial LPBF machine (EOS M290), the STWIP system is demonstrated to be able to quantitatively monitor MP temperature and variation for 50 layers at high framerates (> 30,000 fps) during a print of five standard fatigue specimens. High performance computing is employed to analyze the acquired big data of MP images for determining each MPs average temperature and 2D temperature profile. The MP temperature evolution in the gage section of a fatigue specimen is also examined at a temporal resolution of 1ms by evaluating the derived MP temperatures of the printed samples first, middle and last layers. This paper is first of its kind on monitoring MP temperature distribution and evolution at such a large, detailed scale for longer durations in practical applications. Future work includes MP registration and machine learning of MP-Part Property relations.
Validation and Improvement of Data Assimilation for Flood Hydrodynamic Modelling Using SAR Imagery Data
Authors: Thanh Huy Nguyen, Anthéa Delmotte, Christophe Fatras, Peter Kettig, Andrea Piacentini, Sophie Ricci
Date: 2021-09-09 00:00:00
Tasks: Friction

Relevant comprehension of flood hazards has emerged as a crucial necessity, especially as the severity and the occurrence of flood events intensify with climate changes. Flood simulation and forecast capability have been greatly improved thanks to advances in data assimilation. This approach combines in-situ gauge measurements with hydrodynamic models, aiming to correct the hydraulic states and reduce the uncertainties in the model parameters, e.g., friction coefficients, inflow discharge. These methods depend strongly on the availability and quality of observations, thus requiring other data sources to improve the flood simulation and forecast quality. Sentinel-1 images collected during a flood event were used to classify an observed scene into dry and wet areas. The study area concerns the Garonne Marmandaise catchment, and focuses on recent flood event in January-February 2021. In this paper, seven experiments are carried out, two in free run modes (FR1 and FR2) and five in data assimilation modes (DA1 to DA5). A model-observation bias was diagnosed and corrected over the beginning of the flood event. Quantitative assessments are carried out involving 1D metrics at Vigicrue observing stations and 2D metrics with respect to the Sentinel-1 derived flood extent maps. They demonstrate improvements on flood extent representation thanks to the data assimilation and bias correction.
Improving Reproducibility and Performance of Radiomics in Low Dose CT using Cycle GANs
Authors: Junhua Chen, Leonard Wee, Andre Dekker, Inigo Bermejo
Date: 2021-09-16 00:00:00
Tasks: Denoising, Survival Prediction

As a means to extract biomarkers from medical imaging, radiomics has attracted increased attention from researchers. However, reproducibility and performance of radiomics in low dose CT scans are still poor, mostly due to noise. Deep learning generative models can be used to denoise these images and in turn improve radiomics' reproducibility and performance. However, most generative models are trained on paired data, which can be difficult or impossible to collect. In this article, we investigate the possibility of denoising low dose CTs using cycle generative adversarial networks (GANs) to improve radiomics reproducibility and performance based on unpaired datasets. Two cycle GANs were trained: 1) from paired data, by simulating low dose CTs (i.e., introducing noise) from high dose CTs; and 2) from unpaired real low dose CTs. To accelerate convergence, during GAN training, a slice-paired training strategy was introduced. The trained GANs were applied to three scenarios: 1) improving radiomics reproducibility in simulated low dose CT images and 2) same-day repeat low dose CTs (RIDER dataset) and 3) improving radiomics performance in survival prediction. Cycle GAN results were compared with a conditional GAN (CGAN) and an encoder-decoder network (EDN) trained on simulated paired data.The cycle GAN trained on simulated data improved concordance correlation coefficients (CCC) of radiomic features from 0.87 to 0.93 on simulated noise CT and from 0.89 to 0.92 on RIDER dataset, as well improving the AUC of survival prediction from 0.52 to 0.59. The cycle GAN trained on real data increased the CCCs of features in RIDER to 0.95 and the AUC of survival prediction to 0.58. The results show that cycle GANs trained on both simulated and real data can improve radiomics' reproducibility and performance in low dose CT and achieve similar results compared to CGANs and EDNs.