pwc-archive/papers-with-abstracts huggingface dataset:
S-DCCRN: Super Wide Band DCCRN with learnable complex feature for speech enhancement
Authors: Shubo Lv, Yihui Fu, Mengtao Xing, Jiayao Sun, Lei Xie, Jun Huang, Yannan Wang, Tao Yu
Date: 2021-11-16 00:00:00
Tasks: 16k, Denoising, Speech Denoising, Speech Enhancement

In speech enhancement, complex neural network has shown promising performance due to their effectiveness in processing complex-valued spectrum. Most of the recent speech enhancement approaches mainly focus on wide-band signal with a sampling rate of 16K Hz. However, research on super wide band (e.g., 32K Hz) or even full-band (48K) denoising is still lacked due to the difficulty of modeling more frequency bands and particularly high frequency components. In this paper, we extend our previous deep complex convolution recurrent neural network (DCCRN) substantially to a super wide band version -- S-DCCRN, to perform speech denoising on speech of 32K Hz sampling rate. We first employ a cascaded sub-band and full-band processing module, which consists of two small-footprint DCCRNs -- one operates on sub-band signal and one operates on full-band signal, aiming at benefiting from both local and global frequency information. Moreover, instead of simply adopting the STFT feature as input, we use a complex feature encoder trained in an end-to-end manner to refine the information of different frequency bands. We also use a complex feature decoder to revert the feature to time-frequency domain. Finally, a learnable spectrum compression method is adopted to adjust the energy of different frequency bands, which is beneficial for neural network learning. The proposed model, S-DCCRN, has surpassed PercepNet as well as several competitive models and achieves state-of-the-art performance in terms of speech quality and intelligibility. Ablation studies also demonstrate the effectiveness of different contributions.
SALSA-Lite: A Fast and Effective Feature for Polyphonic Sound Event Localization and Detection with Microphone Arrays
Authors: Thi Ngoc Tho Nguyen, Douglas L. Jones, Karn N. Watcharasupat, Huy Phan, Woon-Seng Gan
Date: 2021-11-16 00:00:00
Tasks: Sound Event Localization and Detection

Polyphonic sound event localization and detection (SELD) has many practical applications in acoustic sensing and monitoring. However, the development of real-time SELD has been limited by the demanding computational requirement of most recent SELD systems. In this work, we introduce SALSA-Lite, a fast and effective feature for polyphonic SELD using microphone array inputs. SALSA-Lite is a lightweight variation of a previously proposed SALSA feature for polyphonic SELD. SALSA, which stands for Spatial Cue-Augmented Log-Spectrogram, consists of multichannel log-spectrograms stacked channelwise with the normalized principal eigenvectors of the spectrotemporally corresponding spatial covariance matrices. In contrast to SALSA, which uses eigenvector-based spatial features, SALSA-Lite uses normalized inter-channel phase differences as spatial features, allowing a 30-fold speedup compared to the original SALSA feature. Experimental results on the TAU-NIGENS Spatial Sound Events 2021 dataset showed that the SALSA-Lite feature achieved competitive performance compared to the full SALSA feature, and significantly outperformed the traditional feature set of multichannel log-mel spectrograms with generalized cross-correlation spectra. Specifically, using SALSA-Lite features increased localization-dependent F1 score and class-dependent localization recall by 15% and 5%, respectively, compared to using multichannel log-mel spectrograms with generalized cross-correlation spectra.
Biologically inspired speech emotion recognition
Authors: Reza Lotfidereshgi, Philippe Gournay
Date: 2021-11-15 00:00:00
Tasks: Emotion Recognition, Speech Emotion Recognition

Conventional feature-based classification methods do not apply well to automatic recognition of speech emotions, mostly because the precise set of spectral and prosodic features that is required to identify the emotional state of a speaker has not been determined yet. This paper presents a method that operates directly on the speech signal, thus avoiding the problematic step of feature extraction. Furthermore, this method combines the strengths of the classical source-filter model of human speech production with those of the recently introduced liquid state machine (LSM), a biologically-inspired spiking neural network (SNN). The source and vocal tract components of the speech signal are first separated and converted into perceptually relevant spectral representations. These representations are then processed separately by two reservoirs of neurons. The output of each reservoir is reduced in dimensionality and fed to a final classifier. This method is shown to provide very good classification performance on the Berlin Database of Emotional Speech (Emo-DB). This seems a very promising framework for solving efficiently many other problems in speech processing.
Multi-channel Multi-frame ADL-MVDR for Target Speech Separation
Authors: Zhuohuang Zhang, Yong Xu, Meng Yu, Shi-Xiong Zhang, LianWu Chen, Donald S. Williamson, Dong Yu
Date: 2020-12-24 00:00:00
Tasks: Automatic Speech Recognition, Automatic Speech Recognition (ASR), speech-recognition, Speech Recognition, Speech Separation

Many purely neural network based speech separation approaches have been proposed to improve objective assessment scores, but they often introduce nonlinear distortions that are harmful to modern automatic speech recognition (ASR) systems. Minimum variance distortionless response (MVDR) filters are often adopted to remove nonlinear distortions, however, conventional neural mask-based MVDR systems still result in relatively high levels of residual noise. Moreover, the matrix inverse involved in the MVDR solution is sometimes numerically unstable during joint training with neural networks. In this study, we propose a multi-channel multi-frame (MCMF) all deep learning (ADL)-MVDR approach for target speech separation, which extends our preliminary multi-channel ADL-MVDR approach. The proposed MCMF ADL-MVDR system addresses linear and nonlinear distortions. Spatio-temporal cross correlations are also fully utilized in the proposed approach. The proposed systems are evaluated using a Mandarin audio-visual corpus and are compared with several state-of-the-art approaches. Experimental results demonstrate the superiority of our proposed systems under different scenarios and across several objective evaluation metrics, including ASR performance.
Sensitivity to User Mischaracterizations in Electric Vehicle Charging
Authors: Cesar Santoyo, Gustav Nilsson, Samuel Coogan
Date: 2021-11-16 00:00:00
Tasks: Sensitivity

In this paper, we consider electric vehicle charging facilities that offer various levels of service for varying prices such that rational users choose a level of service that minimizes the total cost to themselves including an opportunity cost that incorporates users' value of time. In this setting, we study the sensitivity of the expected occupancy at the facility to mischaracterizations of user profiles and uncharacterized heterogeneity. For user profile mischaracterizations, we first provide a fundamental upper bound for the difference between the expected occupancy under any two different distributions on a user's impatience (i.e., value of time) that only depends on the minimum and maximum charging rate offered by the charging facility. Next, we consider the case when a user's impatience is a discrete random variable and study the sensitivity of the expected occupancy to the probability masses and attained values of the random variable. We show that the expected occupancy varies linearly with respect to the probability masses and is piecewise constant with respect to the attained values. Furthermore, we study the effects on the expected occupancy from the occurrence of heterogeneous user populations. In particular, we quantify the effect on the expected occupancy from the existence of sub-populations that may only select a subset of the offered service levels. Lastly, we quantify the variability of early departures on the expected occupancy. These results demonstrate how the facility operator might design prices such that the expected occupancy does not vary much under small changes in the distribution of a user's impatience, variable and limited user service needs, or uncharacterized early departure, quantities which are generally difficult to characterize accurately from data. We further demonstrate our results via examples.
Distributed Optimal Output Consensus of Uncertain Nonlinear Multi-Agent Systems over Unbalanced Directed Networks via Output Feedback
Authors: Jin Zhang, Lu Liu, Xinghu Wang, Haibo Ji
Date: 2021-11-16 00:00:00

In this note, a novel observer-based output feedback control approach is proposed to address the distributed optimal output consensus problem of uncertain nonlinear multi-agent systems in the normal form over unbalanced directed graphs. The main challenges of the concerned problem lie in unbalanced directed graphs and nonlinearities of multi-agent systems with their agent states not available for feedback control. Based on a two-layer controller structure, a distributed optimal coordinator is first designed to convert the considered problem into a reference-tracking problem. Then a decentralized output feedback controller is developed to stabilize the resulting augmented system. A high-gain observer is exploited in controller design to estimate the agent states in the presence of uncertainties and disturbances so that the proposed controller relies only on agent outputs. The semi-global convergence of the agent outputs toward the optimal solution that minimizes the sum of all local cost functions is proved under standard assumptions. A key feature of the obtained results is that the nonlinear agents under consideration are only required to be locally Lipschitz and possess globally asymptotically stable and locally exponentially stable zero dynamics.
Conjugate gradient MIMO iterative learning control using data-driven stochastic gradients
Authors: Leontine Aarnoudse, Tom Oomen
Date: 2021-11-16 00:00:00

Data-driven iterative learning control can achieve high performance for systems performing repeating tasks without the need for modeling. The aim of this paper is to develop a fast data-driven method for iterative learning control that is suitable for massive MIMO systems through the use of efficient unbiased gradient estimates. A stochastic conjugate gradient descent algorithm is developed that uses dedicated experiments to determine the conjugate search direction and optimal step size at each iteration. The approach is illustrated on a multivariable example, and it is shown that the method is superior to both the earlier stochastic gradient descent and deterministic conjugate gradient descent methods.
Batch Model Predictive Control for Selective Laser Melting
Authors: Riccardo Zuliani, Efe C. Balta, Alisa Rupenyan, John Lygeros
Date: 2021-11-16 00:00:00
Tasks: Model Predictive Control

Selective laser melting is a promising additive manufacturing technology enabling the fabrication of highly customizable products. A major challenge in selective laser melting is ensuring the quality of produced parts, which is influenced greatly by the thermal history of printed layers. We propose a Batch-Model Predictive Control technique based on the combination of model predictive control and iterative learning control. This approach succeeds in rejecting both repetitive and non-repetitive disturbances and thus achieves improved tracking performance and process quality. In a simulation study, the selective laser melting dynamics is approximated with a reduced-order control-oriented linear model to ensure reasonable computational complexity. The proposed approach provides convergence to the desired temperature field profile despite model uncertainty and disturbances.
Approximate infinite-horizon predictive control
Authors: Lukas Beckenbach, Stefan Streif
Date: 2021-11-16 00:00:00
Tasks: Model-based Reinforcement Learning

Predictive control is frequently used for control problems involving constraints. Being an optimization based technique utilizing a user specified so-called stage cost, performance properties, i.e., bounds on the infinite horizon accumulated stage cost, aside closed-loop stability are of interest. To achieve good performance and to influence the region of attraction associated with the prediction horizon, the terminal cost of the predictive controller's optimization objective is a key design factor. Approximate dynamic programming refers to one particular approximation paradigm that pursues iterative cost adaptation over a state domain. Troubled by approximation errors, the associated approximate optimal controller is, in general, not necessarily stabilizing nor is its performance quantifiable on the entire approximation domain. Using a parametric terminal cost trained via approximate dynamic programming, a stabilizing predictive controller is proposed whose performance can directly be related to cost approximation errors. The controller further ensures closed-loop asymptotic stability beyond the training domain of the approximate optimal controller associated to the terminal cost.
Development of a miniaturized laser-communication terminal for small satellites
Authors: Alberto Carrasco-Casado, Koichi Shiratama, Phuc V. Trinh, Dimitar Kolev, Yasushi Munemasa, Yoshihiko Saito, Hiroyuki Tsuji, Morio Toyoshima
Date: 2021-11-11 00:00:00

Free-space optical communication is becoming a mature technology that has been demonstrated in space a number of times in the last few years. The Japanese National Institute of Information and Communications Technology (NICT) has carried out some of the most-significant in-orbit demonstrations over the last three decades. However, this technology has not reached a wide commercial adoption yet. For this reason, NICT is currently working towards the development of a miniaturized laser-communication terminal that can be installed in very-small satellites, while also compatible with a variety of other different platforms, meeting a wide span of bandwidth requirements. The strategy adopted in this design has been to create a versatile lasercom terminal that can operate in multiple scenarios and platforms without the need of extensive customization. This manuscript describes the current efforts in NICT towards the development of this terminal, and it shows the prototype that has been already developed for the preliminary tests, which are described as well. These tests will include the performance verification using drones first with the goal of installing the prototype on High-Altitude Platform Systems (HAPS) to carry out communication links between HAPS and ground, and later with the Geostationary (GEO) orbit, covering this way a wide range of operating conditions. For these tests, in the former case the counter terminal is a simple transmitter in the case of the drone, and a transportable ground station in the case of the HAPS; and in the latter case the counter terminal is the GEO satellite ETS-IX, foreseen to be launched by NICT in 2023.
Thermodynamic constraints on the assembly and diversity of microbial ecosystems are different near to and far from equilibrium
Authors: Jacob Cook, Samraat Pawar, Robert G. Endres
Date: 2021-11-16 00:00:00
Tasks: Diversity

Non-equilibrium thermodynamics has long been an area of substantial interest to ecologists because most fundamental biological processes, such as protein synthesis and respiration, are inherently energy-consuming. Microbial communities are a natural system to decipher this mechanistic basis because their interactions in the form of substrate consumption, metabolite production, and cross-feeding can be described explicitly in thermodynamic terms. Previous work has considered how thermodynamic constraints impact competition between pairs of species, but restrained from analysing how this manifests in complex dynamical systems. To address this gap, we develop a thermodynamic microbial community model with fully reversible reaction kinetics, which allows direct consideration of free-energy dissipation. This also allows species to interact via products rather than just substrates, increasing the dynamical complexity, and allowing a more nuanced classification of interaction types to emerge. Using this model, we find that community diversity increases with substrate lability, because greater free-energy availability allows for faster generation of niches. Thus, more niches are generated in the time frame of community establishment, leading to higher final species diversity. We also find that allowing species to make use of near-to-equilibrium reactions increases diversity in a low free-energy regime. In such a regime, two new thermodynamic interaction types that we identify here reach comparable strengths to the conventional (competition and facilitation) types, emphasising the key role that thermodynamics plays in community dynamics. Our results suggest that accounting for realistic thermodynamic constraints is vital for understanding the dynamics of real-world microbial communities.
The structure of gene-gene networks beyond pairwise interactions
Authors: Nastaran Allahyari, Amir Kargaran, Ali Hosseiny, G. R. Jafari
Date: 2021-10-14 00:00:00

Despite its high and direct impact on nearly all biological processes, the underlying structure of gene-gene interaction networks is investigated so far according to pair connections. To address this, we explore the gene interaction networks of the yeast Saccharomyces cerevisiae beyond pairwise interaction using the structural balance theory (SBT). Specifically, we ask whether essential and nonessential gene interaction networks are structurally balanced. We study triadic interactions in the weighted signed undirected gene networks and observe that balanced and unbalanced triads are over and underrepresented in both networks, thus beautifully in line with the strong notion of balance. Moreover, we note that the energy distribution of triads is significantly different in both essential and nonessential networks compared with the shuffled networks. Yet, this difference is greater in the essential network regarding the frequency as well as the energy of triads. Additionally, results demonstrate that triads in the essential gene network are more interconnected through sharing common links, while in the nonessential network they tend to be isolated. Last but not least, we investigate the contribution of all-length signed walks and its impact on the degree of balance. Our findings reveal that interestingly when considering longer cycles the nonessential gene network is more balanced compared to the essential network.
Comparison between Time Shifting Deviation and Cross-correlation Methods
Authors: Zhongwang Pang, Guan Wang, Bo wang, Lijun Wang
Date: 2021-11-15 00:00:00

Time delay estimation (TDE) is an important step to identify and locate vibration source. The TDE result can be obtained by cross-correlation method through seeking the maximum correlation peak of two signals. However, the cross-correlation method will induce random error when dealing with the nonstationary signal. We propose a novel time shifting deviation (TSDEV) method to solve this problem, which has been proved to achieve ultrahigh precision localization result in the fiber vibration monitoring system. This paper compares TSDEV method with cross-correlation in detail by simulating TDE process in different conditions, such as signals with arbitrary intercepted length, nonstationary drift and correlated noise. Besides, experimental demonstration has been carried out on 60 km fiber to localize a wide band vibration signal. The typical localization error is 2 m with standard deviation of 21.4 m using TSDEV method. It stands in clear contrast to the result of cross-correlation method, whose localization error is 70 m and the standard deviation is 208.4 m. Compared with cross-correlation method, TSDEV has the same resistance to white noise, but has fewer boundary conditions and better suppression on linear drift or common noise, which leads to more precise TDE results.
The network epidemiology of an Ebola epidemic
Authors: Laurent Hébert-Dufresne, Jean-Gabriel Young, Jamie Bedson, Laura A. Skrip, Danielle Pedi, Mohamed F. Jalloh, Bastian Raulier, Olivier Lapointe-Gagné, Amara Jambai, Antoine Allard, Benjamin M. Althouse
Date: 2021-11-16 00:00:00
Tasks: Epidemiology

Connecting the different scales of epidemic dynamics, from individuals to communities to nations, remains one of the main challenges of disease modeling. Here, we revisit one of the largest public health efforts deployed against a localized epidemic: the 2014-2016 Ebola Virus Disease (EVD) epidemic in Sierra Leone. We leverage the data collected by the surveillance and contact tracing protocols of the Sierra Leone Ministry of Health and Sanitation, the US Centers for Disease Control and Prevention, and other responding partners to validate a network epidemiology framework connecting the population (incidence), community (local forecasts), and individual (secondary infections) scales of disease transmission. In doing so, we gain a better understanding of what brought the EVD epidemic to an end: Reduction of introduction in new clusters (primary cases), and not reduction in local transmission patterns (secondary infections). We also find that the first 90 days of the epidemic contained enough information to produce probabilistic forecasts of EVD cases; forecasts which we show are confirmed independently by both disease surveillance and contact tracing. Altogether, using data available two months before the start of the international support to the local response, network epidemiology could have inferred heterogeneity in local transmissions, the risk for superspreading events, and probabilistic forecasts of eventual cases per community. We expect that our framework will help connect large data collection efforts with individual behavior, and help reduce uncertainty during health emergencies and emerging epidemics.
A Spatial-temporal Graph Deep Learning Model for Urban Flood Nowcasting Leveraging Heterogeneous Community Features
Authors: Hamed Farahmand, Yuanchang Xu, Ali Mostafavi
Date: 2021-11-09 00:00:00

The objective of this study is to develop and test a novel structured deep-learning modeling framework for urban flood nowcasting by integrating physics-based and human-sensed features. We present a new computational modeling framework including an attention-based spatial-temporal graph convolution network (ASTGCN) model and different streams of data that are collected in real-time, preprocessed, and fed into the model to consider spatial and temporal information and dependencies that improve flood nowcasting. The novelty of the computational modeling framework is threefold; first, the model is capable of considering spatial and temporal dependencies in inundation propagation thanks to the spatial and temporal graph convolutional modules; second, it enables capturing the influence of heterogeneous temporal data streams that can signal flooding status, including physics-based features such as rainfall intensity and water elevation, and human-sensed data such as flood reports and fluctuations of human activity. Third, its attention mechanism enables the model to direct its focus on the most influential features that vary dynamically. We show the application of the modeling framework in the context of Harris County, Texas, as the case study and Hurricane Harvey as the flood event. Results indicate that the model provides superior performance for the nowcasting of urban flood inundation at the census tract level, with a precision of 0.808 and a recall of 0.891, which shows the model performs better compared with some other novel models. Moreover, ASTGCN model performance improves when heterogeneous dynamic features are added into the model that solely relies on physics-based features, which demonstrates the promise of using heterogenous human-sensed data for flood nowcasting,