pwc-archive/papers-with-abstracts huggingface dataset:
Helicopter Track Identification with Autoencoder
Authors: Liya Wang, Panta Lucic, Keith Campbell, Craig Wanke
Date: 2021-03-03 00:00:00
Tasks: Anomaly Detection, Self-Supervised Learning

Computing power, big data, and advancement of algorithms have led to a renewed interest in artificial intelligence (AI), especially in deep learning (DL). The success of DL largely lies on data representation because different representations can indicate to a degree the different explanatory factors of variation behind the data. In the last few year, the most successful story in DL is supervised learning. However, to apply supervised learning, one challenge is that data labels are expensive to get, noisy, or only partially available. With consideration that we human beings learn in an unsupervised way; self-supervised learning methods have garnered a lot of attention recently. A dominant force in self-supervised learning is the autoencoder, which has multiple uses (e.g., data representation, anomaly detection, denoise). This research explored the application of an autoencoder to learn effective data representation of helicopter flight track data, and then to support helicopter track identification. Our testing results are promising. For example, at Phoenix Deer Valley (DVT) airport, where 70% of recorded flight tracks have missing aircraft types, the autoencoder can help to identify twenty-two times more helicopters than otherwise detectable using rule-based methods; for Grand Canyon West Airport (1G4) airport, the autoencoder can identify thirteen times more helicopters than a current rule-based approach. Our approach can also identify mislabeled aircraft types in the flight track data and find true types for records with pseudo aircraft type labels such as HELO. With improved labelling, studies using these data sets can produce more reliable results.
Fast On-Device Adaptation for Spiking Neural Networks via Online-Within-Online Meta-Learning
Authors: Bleema Rosenfeld, Bipin Rajendran, Osvaldo Simeone
Date: 2021-02-21 00:00:00
Tasks: Lifelong learning, Management, Meta-Learning

Spiking Neural Networks (SNNs) have recently gained popularity as machine learning models for on-device edge intelligence for applications such as mobile healthcare management and natural language processing due to their low power profile. In such highly personalized use cases, it is important for the model to be able to adapt to the unique features of an individual with only a minimal amount of training data. Meta-learning has been proposed as a way to train models that are geared towards quick adaptation to new tasks. The few existing meta-learning solutions for SNNs operate offline and require some form of backpropagation that is incompatible with the current neuromorphic edge-devices. In this paper, we propose an online-within-online meta-learning rule for SNNs termed OWOML-SNN, that enables lifelong learning on a stream of tasks, and relies on local, backprop-free, nested updates.
Surface Warping Incorporating Machine Learning Assisted Domain Likelihood Estimation: A New Paradigm in Mine Geology Modelling and Automation
Authors: Raymond Leung, Mehala Balamurali, Alexander Lowe
Date: 2021-02-15 00:00:00
Tasks: BIG-bench Machine Learning

This paper illustrates an application of machine learning (ML) within a complex system that performs grade estimation. In surface mining, assay measurements taken from production drilling often provide useful information that allows initially inaccurate surfaces created using sparse exploration data to be revised and subsequently improved. Recently, a Bayesian warping technique has been proposed to reshape modeled surfaces using geochemical and spatial constraints imposed by newly acquired blasthole data. This paper focuses on incorporating machine learning into this warping framework to make the likelihood computation generalizable. The technique works by adjusting the position of vertices on the surface to maximize the integrity of modeled geological boundaries with respect to sparse geochemical observations. Its foundation is laid by a Bayesian derivation in which the geological domain likelihood given the chemistry, p(g|c), plays a similar role to p(y(c)|g). This observation allows a manually calibrated process centered around the latter to be automated since ML techniques may be used to estimate the former in a data-driven way. Machine learning performance is evaluated for gradient boosting, neural network, random forest and other classifiers in a binary and multi-class context using precision and recall rates. Once ML likelihood estimators are integrated in the surface warping framework, surface shaping performance is evaluated using unseen data by examining the categorical distribution of test samples located above and below the warped surface. Large-scale validation experiments are performed to assess the overall efficacy of ML assisted surface warping as a fully integrated component within an ore grade estimation system where the posterior mean is obtained via Gaussian Process inference with a Matern 3/2 kernel.
Augmenting High-dimensional Nonlinear Optimization with Conditional GANs
Authors: Pouya Rezazadeh Kalehbasti, Michael D. Lepech, Samarpreet Singh Pandher
Date: 2021-02-20 00:00:00
Tasks: Diversity, Generative Adversarial Network, Vocal Bursts Intensity Prediction

Many mathematical optimization algorithms fail to sufficiently explore the solution space of high-dimensional nonlinear optimization problems due to the curse of dimensionality. This paper proposes generative models as a complement to optimization algorithms to improve performance in problems with high dimensionality. To demonstrate this method, a conditional generative adversarial network (C-GAN) is used to augment the solutions produced by a genetic algorithm (GA) for a 311-dimensional nonconvex multi-objective mixed-integer nonlinear optimization. The C-GAN, composed of two networks with three fully connected hidden layers, is trained on solutions generated by GA, and then given sets of desired labels (i.e., objective function values), generates complementary solutions corresponding to those labels. Six experiments are conducted to evaluate the capabilities of the proposed method. The generated complementary solutions are compared to the original solutions in terms of optimality and diversity. The generative model generates solutions with objective functions up to 100% better, and with hypervolumes up to 100% higher, than the original solutions. These findings show that a C-GAN with even a simple training approach and architecture can, with a much shorter runtime, highly improve the diversity and optimality of solutions found by an optimization algorithm for a high-dimensional nonlinear optimization problem. [Link to GitHub repository: https://github.com/PouyaREZ/GAN_GA]
A Case for 3D Integrated System Design for Neuromorphic Computing & AI Applications
Authors: Eren Kurshan, Hai Li, Mingoo Seok, Yuan Xie
Date: 2021-03-02 00:00:00

Over the last decade, artificial intelligence has found many applications areas in the society. As AI solutions have become more sophistication and the use cases grew, they highlighted the need to address performance and energy efficiency challenges faced during the implementation process. To address these challenges, there has been growing interest in neuromorphic chips. Neuromorphic computing relies on non von Neumann architectures as well as novel devices, circuits and manufacturing technologies to mimic the human brain. Among such technologies, 3D integration is an important enabler for AI hardware and the continuation of the scaling laws. In this paper, we overview the unique opportunities 3D integration provides in neuromorphic chip design, discuss the emerging opportunities in next generation neuromorphic architectures and review the obstacles. Neuromorphic architectures, which relied on the brain for inspiration and emulation purposes, face grand challenges due to the limited understanding of the functionality and the architecture of the human brain. Yet, high-levels of investments are dedicated to develop neuromorphic chips. We argue that 3D integration not only provides strategic advantages to the cost-effective and flexible design of neuromorphic chips, it may provide design flexibility in incorporating advanced capabilities to further benefits the designs in the future.
Info-Evo: Using Information Geometry to Guide Evolutionary Program Learning
Authors: Ben Goertzel
Date: 2021-02-20 00:00:00

A novel optimization strategy, Info-Evo, is described, in which natural gradient search using nonparametric Fisher information is used to provide ongoing guidance to an evolutionary learning algorithm, so that the evolutionary process preferentially moves in the directions identified as "shortest paths" according to the natural gradient. Some specifics regarding the application of this approach to automated program learning are reviewed, including a strategy for integrating Info-Evo into the MOSES program learning framework.
A Memory Optimized Data Structure for Binary Chromosomes in Genetic Algorithm
Authors: Avijit Basak
Date: 2021-02-24 00:00:00

This paper presents a memory-optimized metadata-based data structure for implementation of binary chromosome in Genetic Algorithm. In GA different types of genotypes are used depending on the problem domain. Among these, binary genotype is the most popular one for non-enumerated encoding owing to its representational and computational simplicity. This paper proposes a memory-optimized implementation approach of binary genotype. The approach improves the memory utilization as well as capacity of retaining alleles. Mathematical proof has been provided to establish the same.
On Asymptotic Log-Optimal Buy-and-Hold Strategy
Authors: Chung-Han Hsieh
Date: 2021-03-08 00:00:00
Tasks: LEMMA, Portfolio Optimization

In this paper, we consider a frequency-based portfolio optimization problem with $m \geq 2$ assets when the expected logarithmic growth (ELG) rate of wealth is used as the performance metric. With the aid of the notion called dominant asset, it is known that the optimal ELG level is achieved by investing all available funds on that asset. However, such an "all-in" strategy is arguably too risky to implement in practice. Motivated by this issue, we study the case where the portfolio weights are chosen in a rather ad-hoc manner and a buy-and-hold strategy is subsequently used. Then we show that, if the underlying portfolio contains a dominant asset, buy and hold on that specific asset is asymptotically log-optimal with a sublinear rate of convergence. This result also extends to the scenario where a trader either does not have a probabilistic model for the returns or does not trust a model obtained from historical data. To be more specific, we show that if a market contains a dominant asset, buy and hold a market portfolio involving nonzero weights for each asset is asymptotically log-optimal. Additionally, this paper also includes a conjecture regarding the property called high-frequency maximality. That is, in the absence of transaction costs, high-frequency rebalancing is unbeatable in the ELG sense. Support for the conjecture, involving a lemma for a weak version of the conjecture, is provided. This conjecture, if true, enables us to improve the log-optimality result obtained previously. Finally, a result that indicates a way regarding an issue about when should one to rebalance their portfolio if needed, is also provided. Examples, some involving simulations with historical data, are also provided along the way to illustrate the~theory.
On the Analysis and Design of High-Frequency Transformers for Dual and Triple Active Bridge Converters in More Electric Aircraft
Authors: Babak Rahrovi, Ramin Tafazzoli Mehrjardi, Mehrdad Ehsani
Date: 2021-03-08 00:00:00

DC-DC converters with galvanic isolation are a key element in the aircraft DC distribution system and Dual and Triple Active Bridge converters are one of the most interesting candidates in this application. The high-frequency transformer leakage inductances play a key role in the AC Link of these converters. This leakage inductances determine the power transfer capability of the converter and shape the AC link currents. The leakage inductance value is related to the distribution of the transformer windings and it changes with the RMS value of the AC link current. In this paper, first a high frequency transformer is designed for a Dual and Triple Active Bridge converter for the More Electric Aircraft DC power system. Then, an Ansys/Maxwell Finite Element analysis is performed on the leakage inductances of the transformer in three different winding configurations and in different AC link RMS current values. Finally, the transient performance of the design is validated by the Ansys/Maxwell Transient.
Generation of tubular and membranous shape textures with curvature functionals
Authors: Anna Song
Date: 2021-03-08 00:00:00
Tasks: GPU

Tubular and membranous shapes display a wide range of morphologies that are difficult to analyze within a common framework. By generalizing the classical Helfrich energy of biomembranes, we model them as solutions to a curvature optimization problem in which the principal curvatures may play asymmetric roles. We then give a novel phase-field formulation to approximate this geometric problem, and study its Gamma-limsup convergence. This results in an efficient GPU algorithm that we validate on well-known minimizers of the Willmore energy; the software for the implementation of our algorithm is freely available online. Exploring the space of parameters reveals that this comprehensive framework leads to a wide continuum of shape textures. This first step towards a unifying theory will have several implications, in biology for quantifying tubular shapes or designing bio-mimetic scaffolds, but also in computer graphics or architecture.
Spatial- and Range- ISLR Trade-off in MIMO Radar via Waveform Correlation Optimization
Authors: Ehsan Raei, Mohammad Alaee-Kerahrood, M. R. Bhavani Shankar
Date: 2021-03-08 00:00:00

This paper aims to design a set of transmitting waveforms in cognitive colocated Multi-Input Multi-Output (MIMO) radar systems considering the simultaneous minimization of spatial- and the range- Integrated Sidelobe Level Ratio (ISLR). The design problem is formulated as a bi-objective Pareto optimization under practical constraints on the waveforms, namely total transmit power, peak-to-average-power ratio (PAR), constant modulus, and discrete phase alphabet. A Coordinate Descent (CD) based approach is proposed, in which at every single variable update of the algorithm we obtain the solution of the uni-variable optimization problems. The novelty of the paper comes from deriving a flexible waveform design problem applicable for 4D imaging MIMO radars which is optimized directly over the different constraint sets. The simultaneous optimization leads to a trade-off between the two ISLRs and the simulation results illustrate significantly improved trade-off offered by the proposed methodologies.
A microstructural model of tendon failure
Authors: James Gregory, Tom Shearer, Andrew L. Hazel
Date: 2021-03-08 00:00:00
Tasks: model

Collagen fibrils are the most important structural component of tendons. Their crimped structure and parallel arrangement within the tendon lead to a distinctive non-linear stress-strain curve when a tendon is stretched. Microstructural models can be used to relate microscale collagen fibril mechanics to macroscale tendon mechanics, allowing us to identify the mechanisms behind each feature present in the stress-strain curve. Most models in the literature focus on the elastic behaviour of the tendon, and there are few which model beyond the elastic limit without introducing phenomenological parameters. We develop a model, built upon a collagen recruitment approach, that only contains microstructural parameters. We split the stress in the fibrils into elastic and plastic parts, and assume that the fibril yield stretch and rupture stretch are each described by a distribution function, rather than being single-valued. By changing the shapes of the distributions and their regions of overlap, we can produce macroscale tendon stress-strain curves that generate the full range of features observed experimentally, including those that could not be explained using existing models. These features include second linear regions occurring after the tendon has yielded, and step-like failure behaviour present after the stress has peaked. When we compare with an existing model, we find that our model reduces the average root mean squared error from 4.15MPa to 1.61MPa, and the resulting parameter values are closer to those found experimentally. Since our model contains only parameters that have a direct physical interpretation, it can be used to predict how processes such as ageing, disease, and injury affect the mechanical behaviour of tendons, provided we can quantify the effects of these processes on the microstructure.
What is the potential for a second peak in the evolution of SARS-CoV-2 in emerging and developing economies? Insights from a SIRASD model considering the informal economy
Authors: Marcelo A. Pires, Nuno Crokidakis, Daniel O. Cajueiro, Marcio Argollo de Menezes, Silvio M. Duarte Queirós
Date: 2020-05-18 00:00:00
Tasks: valid

We study the potential scenarios from a Susceptible-Infected-Recovered-Asymptomatic-Symptomatic-Dead (SIRASD) model. As a novelty, we consider populations that differ in their degree of compliance with social distancing policies following socioeconomic attributes that are observed in emerging and developing countries. Considering epidemiological parameters estimated from data of the propagation of SARS-CoV-2 in Brazil -- where there is a significant stake of the population making their living in the informal economy and thus prone to not follow self-isolation -- we assert that if the confinement measures are lifted too soon, namely as much as one week of consecutive declining numbers of new cases, it is very likely the appearance of a second peak. Our approach should be valid for any country where the number of people involved in the informal economy is a large proportion of the total labor force. In summary, our results point out the crucial relevance of target policies for supporting people in the informal economy to properly comply with preventive measures during the pandemic.
An Ultra-low Power RNN Classifier for Always-On Voice Wake-Up Detection Robust to Real-World Scenarios
Authors: Emmanuel Hardy, Franck Badets
Date: 2021-03-08 00:00:00
Tasks: Action Detection, Activity Detection, Automatic Speech Recognition, Automatic Speech Recognition (ASR), Keyword Spotting, Speaker Verification, speech-recognition, Speech Recognition

We present in this paper an ultra-low power (ULP) Recurrent Neural Network (RNN) based classifier for an always-on voice Wake-Up Sensor (WUS) with performances suitable for real-world applications. The purpose of our sensor is to bring down by at least a factor 100 the power consumption in background noise of always-on speech processing algorithms such as Automatic Speech Recognition, Keyword Spotting, Speaker Verification, etc. Unlike the other published approaches, we designed our wake-up sensor to be robust to unseen real-world noises for realistic levels of speech and noise by carefully designing the dataset and the loss function. We also specifically trained it to mark only the speech start rather than adopting a traditional Voice Activity Detection (VAD) approach. We achieve less than 3% No Trigger Rate (NTR) for a duty cycle less than 1% in challenging background noises pooled using a model of an analogue front-end. We demonstrate the superiority of RNNs on this task compared to the other tested approaches, with an estimated power consumption of 45 nW for the RNN itself in 65nm CMOS and a minimal memory footprint of 0.52 kB.
Optimal Scheduling of Integrated Demand Response-Enabled Integrated Energy Systems with Uncertain Renewable Generations: A Stackelberg Game Approach
Authors: Yang Li, Chunling Wang, Guoqing Li, Chen Chen
Date: 2021-03-08 00:00:00
Tasks: Scheduling

In order to balance the interests of integrated energy operator (IEO) and users, a novel Stackelberg game-based optimization framework is proposed for the optimal scheduling of integrated demand response (IDR)-enabled integrated energy systems with uncertain renewable generations, where the IEO acts as the leader who pursues the maximization of his profits by setting energy prices, while the users are the follower who adjusts energy consumption plans to minimize their energy costs. Taking into account the inherent uncertainty of renewable generations, the probabilistic spinning reserve is written in the form of a chance constraint; in addition, a district heating network model is built considering the characteristics of time delay and thermal attenuation by fully exploiting its potential, and the flexible thermal comfort requirements of users in IDR are considered by introducing a predicted mean vote (PMV) index. To solve the raised model, sequence operation theory is introduced to convert the chance constraint into its deterministic equivalent form, and thereby, the leader-follower Stackelberg game is tackled into a mixed-integer quadratic programming formulation through Karush-Kuhn-Tucker optimality conditions and is finally solved by the CPLEX optimizer. The results of two case studies demonstrate that the proposed Stackelberg game-based approach manages to achieve the Stackelberg equilibrium between IEO and users by the coordination of renewable generations and IDR. Furthermore, the study on a real integrated energy system in China verifies the applicability of the proposed approach for real-world applications.
A disjunctive cut strengthening technique for convex MINLP
Authors: Jan Kronqvist, Ruth Misener
Date: 2020-08-11 00:00:00
Tasks: valid

Generating polyhedral outer approximations and solving mixed-integer linear relaxations remains one of the main approaches for solving convex mixed-integer nonlinear programming (MINLP) problems. There are several algorithms based on this concept, and the efficiency is greatly affected by the tightness of the outer approximation. In this paper, we present a new framework for strengthening cutting planes of nonlinear convex constraints, to obtain tighter outer approximations. The strengthened cuts can give a tighter continuous relaxation and an overall tighter representation of the nonlinear constraints. The cuts are strengthened by analyzing disjunctive structures in the MINLP problem, and we present two types of strengthened cuts. The first type of cut is obtained by reducing the right-hand side value of the original cut, such that it forms the tightest generally valid inequality for a chosen disjunction. The second type of cut effectively uses individual right-hand side values for each term of the disjunction. We prove that both types of cuts are valid and that the second type of cut can dominate both the first type and the original cut. We use the cut strengthening in conjunction with the extended supporting hyperplane algorithm, and numerical results show that the strengthening can significantly reduce both the number of iterations and the time needed to solve convex MINLP problems.