pwc-archive/papers-with-abstracts huggingface dataset:
Reinforcement Learning-Based Controlled Switching Approach for Inrush Current Minimization in Power Transformers
Authors: Jone Ugarte Valdivielso, Jose I. Aizpurua, Manex Barrenetxea, Brian G. Stewart
Date: 2025-03-14 00:00:00
Tasks: Reinforcement Learning (RL)

Transformers are essential components for the reliable operation of power grids. The transformer core is constituted by a ferromagnetic material, and accordingly, depending on the magnetization state, the energization of the transformer can lead to high magnetizing inrush currents. Such high amplitudes shorten the life expectancy of a transformer and cause power quality issues in power grids. Various techniques have been proposed to minimize the inrush current; however, the application of Reinforcement Learning (RL) for this challenge has not been investigated. RL incorporates the ability to learn inrush minimization strategies adjusted to the dynamic transformer operation environment. This study proposes an inrush current minimization framework by combining controlled switching with RL. Depending on the opening angle of the circuit breaker and the remanent fluxes at disconnection, the proposed method learns the optimal closing instant of the circuit breaker. Two RL algorithms have been trained and tested through an equivalent duality-based model of a real 7.4 MVA power transformer. The evaluation of the RL algorithms is carried out with real measurement data and compared with real laboratory inrush currents. The results show that the inrush current is effectively minimized with the proposed framework.
Learning-Based MPC for Fuel Efficient Control of Autonomous Vehicles with Discrete Gear Selection
Authors: Samuel Mallick, Gianpietro Battocletti, Qizhang Dong, Azita Dabiri, Bart De Schutter
Date: 2025-03-14 00:00:00
Tasks: Autonomous Driving, Autonomous Vehicles, Model Predictive Control, Position

Co-optimization of both vehicle speed and gear position via model predictive control (MPC) has been shown to offer benefits for fuel-efficient autonomous driving. However, optimizing both the vehicle's continuous dynamics and discrete gear positions may be too computationally intensive for a real-time implementation. This work proposes a learning-based MPC scheme to address this issue. A policy is trained to select and fix the gear positions across the prediction horizon of the MPC controller, leaving a significantly simpler continuous optimization problem to be solved online. In simulation, the proposed approach is shown to have a significantly lower computation burden and a comparable performance, with respect to pure MPC-based co-optimization.
Inverter Control with Time-Varying and Nonconvex State and Input Constraints
Authors: Zixiao Ma, Baosen Zhang
Date: 2025-03-14 00:00:00
Tasks: LEMMA

The growing integration of inverter-based resources (IBRs) into modern power systems poses significant challenges for maintaining reliable operation under dynamic and constrained conditions. This paper focuses on the power tracking problem for grid-connected IBRs, addressing the complexities introduced by voltage and power factor constraints. Voltage constraints, being time-varying and nonlinear input constraints, often conflict with power factor constraints, which are state constraints. These conflicts, coupled with stability requirements, add substantial complexity to control design. To overcome these challenges, we propose a computationally efficient static state-feedback controller that guarantees stability and satisfies operational constraints. The concept of achievability is introduced to evaluate whether power setpoints can be accurately tracked while adhering to all constraints. Using a parameterization framework and the S-lemma, we develop criteria to assess and maximize the continuous achievable region for IBR operation. This framework allows system operators to ensure safety and stability by precomputing a finite set of control gains, significantly reducing online computational requirements. The proposed approach is validated through simulations, demonstrating its effectiveness in handling time-varying grid disturbances and achieving reliable control performance.
Evaluation of the Impact of IBR on the Frequency Dynamics in the Brazilian Power System
Authors: Bruno Pinheiro, M. C. Llerena Velasquez, Giovane Faria, A. F. C. Aquino, Diego Issicaba, Daniel Dotta
Date: 2025-03-14 00:00:00

In this paper, the impact of inverter-based resources (IBRs) on the frequency dynamics of the Brazilian Interconnected Power System (BIPS) is evaluated. A measurement-based framework is proposed to assess the impact of IBR penetration on the system-wide and regional/local frequency dynamic. The analysis leverages data from a low-voltage wide area monitoring system (WAMS) and publicly available historical generation records from the Brazilian System Operator. A methodology is introduced to extract local frequency fluctuations across regions using a variational mode decomposition (VMD) approach. The findings reveal a continuous degradation in the system-wide frequency and local frequency variations, underscoring the need for enhanced regional monitoring and evaluation metrics to maintain frequency stability in large-scale interconnected systems.
Approximate Hamilton-Jacobi Reachability Analysis for a Class of Two-Timescale Systems, with Application to Biological Models
Authors: Dylan Hirsch, Sylvia Herbert
Date: 2025-03-14 00:00:00

Hamilton-Jacobi reachability (HJR) is an exciting framework used for control of safety-critical systems with nonlinear and possibly uncertain dynamics. However, HJR suffers from the curse of dimensionality, with computation times growing exponentially in the dimension of the system state. Many autonomous and controlled systems involve dynamics that evolve on multiple timescales, and for these systems, singular perturbation methods can be used for model reduction. However, such methods are more challenging to apply in HJR due to the presence of an underlying differential game. In this work, we leverage prior work on singularly perturbed differential games to identify a class of systems which can be readily reduced, and we relate these results to the quantities of interest in HJR. We demonstrate the utility of our results on two examples involving biological systems, where dynamics fitting the identified class are frequently encountered.
A Weighted Predict-and-Optimize Framework for Power System Operation Considering Varying Impacts of Uncertainty
Authors: Yingrui Zhuang, Lin Cheng, Can Wan, Rui Xie, Ning Qi, Yue Chen
Date: 2025-03-14 00:00:00
Tasks: Decision Making, Decision Making Under Uncertainty, Multi-Task Learning, Prediction

Integrating prediction and optimization enhances decision-making quality by yielding near optimal solutions. Given that prediction errors associated with multiple uncertainties have varying impacts on downstream decision-making, improving the prediction accuracy of critical uncertainties with significant impacts on decision-making quality yields better optimization results. Inspired by this observation, this paper proposes a novel weighted predict-and-optimize (WPO) framework for decision-making under uncertainty. Specifically, we introduce an uncertainty-aware weighting mechanism into the predictive model to capture the relative importance of each uncertainty for specific optimization tasks, and introduce a problem-driven prediction loss (PDPL) to quantify the suboptimality of weighted predictions for downstream optimization as compared to perfect predictions. By optimizing the uncertainty weights to minimize the PDPL, WPO framework enables adaptive uncertainty impact assessment and integrated learning of prediction and optimization. Furthermore, to facilitate weight optimization, we construct a surrogate model to establish the mapping between weights and PDPL, where multi-task learning and enhanced graph convolutional networks are adopted for efficient surrogate model construction and training. Numerical experiments on modified IEEE 33-bus and 123-bus systems demonstrate that the proposed WPO framework outperforms traditional methods by achieving a much smaller PDPL within acceptable computational time.
Safe Control of Second-Order Systems with Linear Constraints
Authors: Mohammed Alyaseen, Nikolay Atanasov, Jorge Cortes
Date: 2025-03-13 00:00:00
Tasks: valid

Control barrier functions (CBFs) offer a powerful tool for enforcing safety specifications in control synthesis. This paper deals with the problem of constructing valid CBFs. Given a second-order system and any desired safety set with linear boundaries in the position space, we construct a provably control-invariant subset of this desired safety set. The constructed subset does not sacrifice any positions allowed by the desired safety set, which can be nonconvex. We show how our construction can also meet safety specification on the velocity. We then demonstrate that if the system satisfies standard Euler-Lagrange systems properties then our construction can also handle constraints on the allowable control inputs. We finally show the efficacy of the proposed method in a numerical example of keeping a 2D robot arm safe from collision.
Adaptive model predictive control for traffic signal timing with unknown demand and parameters
Authors: Zhexian Li, Ketan Savla
Date: 2025-03-13 00:00:00
Tasks: Model Predictive Control, Traffic Signal Control

This paper designs traffic signal control policies for a network of signalized intersections without knowing the demand and parameters. Within a model predictive control (MPC) framework, control policies consist of an algorithm that estimates parameters and a one-step MPC that computes control inputs using estimated parameters. The algorithm switches between different terminal sets of the MPC to explore different regions of the state space, where different parameters are identifiable. The one-step MPC minimizes a cost that approximates the sum of squares of all the queue lengths within a constant and does not require demand information. We show that the algorithm can estimate parameters exactly in finite time, and the one-step MPC renders maximum throughput in terms of input-to-state practical stability. Simulations indicate better transient performance regarding queue lengths under our proposed policies than existing ones.
A review on modelling, evaluation, and optimization of cyber-physical system reliability
Authors: Moslem Uddin, Huadong Mo, Daoyi Dong
Date: 2025-03-13 00:00:00

The aim of this study is to present an overview of current research on modelling, evaluation, and optimization methods for improving the reliability of Cyber-Physical System (CPS). Three major modelling approaches, namely analytical, simulation, and hybrid models, are discussed. Various evaluation techniques, including fault tree analysis, Markov models, and availability measures, are reviewed and compared. Optimization strategies for CPS reliability, including fault tolerance, dynamic reconfiguration, and resource allocation, are also reviewed and briefly discussed. Besides, emerging trends and research opportunities in this field are highlighted and explained. Finally, the possible challenges are outlined and then future research are directed for CPS. This study can provide a systematic and in-dept introduction to CPS for researchers, practitioners, and policymakers.
Degradation-Aware Microgrid Optimal Planning: Integrating Dynamic Energy Efficiencies and Second-Life Battery Potential
Authors: Hassan Zahid Butt, Xingpeng Li
Date: 2025-03-13 00:00:00
Tasks: Asset Management

Traditional microgrid planning often overlooks PV and BESS degradation or relies on complex, downscaled models, leading to unreliable, costly and suboptimal investment decisions. This paper presents a degradation-based investment optimization (DBIO) methodology for long-term microgrid planning. The model optimally sizes and schedules PV, BESS, and controllable distributed energy resources, while considering technical, financial, and degradation characteristics. We first developed a cumulative multi-year optimization model as a benchmark, excluding BESS efficiency fade and capacity degradation that would be captured in the next step, to ensure convergence. Subsequently, a yearly validation model was iteratively solved for each year in the planning horizon, updating energy efficiencies of PV and BESS, along with BESS capacity, based on annual degradation, ensuring the reliability of initial solution. An iterative refinement process further adjusts BESS capacity to eliminate load shedding while minimizing costs. Sensitivity analyses on PV efficiency degradation rates, second-life battery (SLB) capital cost, and grid tariffs further explore their economic implications. Results show that degradation significantly impacts resource allocation, with ignored degradation risking reliability, potential load shedding, and blackout costs, while SLBs provide cost-saving opportunities. The DBIO framework offers a computationally efficient and scalable solution for microgrid planning, with broader applications in grid-scale asset management.
On Dynamic Mode Decomposition of Control-affine Systems
Authors: Moad Abudia, Joel A. Rosenfeld, Rushikesh Kamalapurkar
Date: 2025-03-13 00:00:00

This paper builds on the theoretical foundations for dynamic mode decomposition (DMD) of control-affine dynamical systems by leveraging the theory of vector-valued reproducing kernel Hilbert spaces (RKHSs). Specifically, control Liouville operators and control occupation kernels are used to separate the drift dynamics from the input dynamics. A provably convergent finite-rank estimation of a compact control Liouville operator is obtained, provided sufficiently rich data are available. A matrix representation of the finite-rank operator is used to construct a data-driven representation of its singular values, left singular functions, and right singular functions. The singular value decomposition is used to generate a data-driven model of the control-affine nonlinear system. The developed method generates a model that can be used to predict the trajectories of the system in response to any admissible control input. Numerical experiments are included to demonstrate the efficacy of the developed technique.
Efficient Reachability Analysis for Convolutional Neural Networks Using Hybrid Zonotopes
Authors: Yuhao Zhang, Xiangru Xu
Date: 2025-03-13 00:00:00
Tasks: Efficient Neural Network

Feedforward neural networks are widely used in autonomous systems, particularly for control and perception tasks within the system loop. However, their vulnerability to adversarial attacks necessitates formal verification before deployment in safety-critical applications. Existing set propagation-based reachability analysis methods for feedforward neural networks often struggle to achieve both scalability and accuracy. This work presents a novel set-based approach for computing the reachable sets of convolutional neural networks. The proposed method leverages a hybrid zonotope representation and an efficient neural network reduction technique, providing a flexible trade-off between computational complexity and approximation accuracy. Numerical examples are presented to demonstrate the effectiveness of the proposed approach.
A theory of ecological invasions and its implications for eco-evolutionary dynamics
Authors: Zhijie Feng, Emmy Blumenthal, Pankaj Mehta, Akshit Goyal
Date: 2025-03-13 00:00:00
Tasks: valid

Predicting the outcomes of species invasions is a central goal of ecology, a task made especially challenging due to ecological feedbacks. To address this, we develop a general theory of ecological invasions applicable to a wide variety of ecological models: including Lotka-Volterra models, consumer resource models, and models with cross feeding. Importantly, our framework remains valid even when invading evolved (non-random) communities and accounts for invasion-driven species extinctions. We derive analytical expressions relating invasion fitness to invader abundance, shifts in the community, and extinction probabilities. These results can be understood through a new quantity we term ``dressed invasion fitness'', which augments the traditional notion of invasion fitness by incorporating ecological feedbacks. We apply our theory to analyze short-term evolutionary dynamics through a series of invasions by mutants whose traits are correlated with an existing parent. We demonstrate that, generically, mutants and parents can coexist, often by driving the extinction of low-abundance species. We validate theoretical predictions against experimental datasets spanning ecosystems from plants to microbial protists. Our work highlights the central role of ecological feedbacks in shaping community responses to invasions and mutations, suggesting that parent-mutant coexistence is widespread in eco-evolutionary dynamics.
Lessons from the trenches on evaluating machine-learning systems in materials science
Authors: Nawaf Alampara, Mara Schilling-Wilhelmi, Kevin Maik Jablonka
Date: 2025-03-13 00:00:00
Tasks: scientific discovery

Measurements are fundamental to knowledge creation in science, enabling consistent sharing of findings and serving as the foundation for scientific discovery. As machine learning systems increasingly transform scientific fields, the question of how to effectively evaluate these systems becomes crucial for ensuring reliable progress. In this review, we examine the current state and future directions of evaluation frameworks for machine learning in science. We organize the review around a broadly applicable framework for evaluating machine learning systems through the lens of statistical measurement theory, using materials science as our primary context for examples and case studies. We identify key challenges common across machine learning evaluation such as construct validity, data quality issues, metric design limitations, and benchmark maintenance problems that can lead to phantom progress when evaluation frameworks fail to capture real-world performance needs. By examining both traditional benchmarks and emerging evaluation approaches, we demonstrate how evaluation choices fundamentally shape not only our measurements but also research priorities and scientific progress. These findings reveal the critical need for transparency in evaluation design and reporting, leading us to propose evaluation cards as a structured approach to documenting measurement choices and limitations. Our work highlights the importance of developing a more diverse toolbox of evaluation techniques for machine learning in materials science, while offering insights that can inform evaluation practices in other scientific domains where similar challenges exist.
Image Reconstruction from an Elastically Distorted Scan
Authors: Adrian Lopez, L. Mahadevan
Date: 2025-03-14 00:00:00
Tasks: Image Reconstruction

We consider the problem of inverting the artifacts associated with scanning a page from an open book, i.e. "xeroxing." The process typically leads to a non-uniform combination of distortion, blurring and darkening owing to the fact that the page is bound to a stiff spine that causes the sheet of paper to be bent inhomogeneously. Complementing purely data-driven approaches, we use knowledge about the geometry and elasticity of the curved sheet to pose and solve a minimal physically consistent inverse problem to reconstruct the image. Our results rely on 3 dimensionless parameters, all of which can be measured for a scanner, and show that we can improve on the data-driven approaches. More broadly, our results might serve as a "textbook" example and a tutorial of how knowledge of generative mechanisms can speed up the solution of inverse problems.
Learning to reset in target search problems
Authors: Gorka Muñoz-Gil, Hans J. Briegel, Michele Caraglio
Date: 2025-03-14 00:00:00
Tasks: reinforcement-learning, Reinforcement Learning, Reinforcement Learning (RL)

Target search problems are central to a wide range of fields, from biological foraging to the optimization algorithms. Recently, the ability to reset the search has been shown to significantly improve the searcher's efficiency. However, the optimal resetting strategy depends on the specific properties of the search problem and can often be challenging to determine. In this work, we propose a reinforcement learning (RL)-based framework to train agents capable of optimizing their search efficiency in environments by learning how to reset. First, we validate the approach in a well-established benchmark: the Brownian search with resetting. There, RL agents consistently recover strategies closely resembling the sharp resetting distribution, known to be optimal in this scenario. We then extend the framework by allowing agents to control not only when to reset, but also their spatial dynamics through turning actions. In this more complex setting, the agents discover strategies that adapt both resetting and turning to the properties of the environment, outperforming the proposed benchmarks. These results demonstrate how reinforcement learning can serve both as an optimization tool and a mechanism for uncovering new, interpretable strategies in stochastic search processes with resetting.
NeuMC -- a package for neural sampling for lattice field theories
Authors: Piotr Bialas, Piotr Korcyl, Tomasz Stebel, Dawid Zapolski
Date: 2025-03-14 00:00:00

We present the \texttt{NeuMC} software package, based on \pytorch, aimed at facilitating the research on neural samplers in lattice field theories. Neural samplers based on normalizing flows are becoming increasingly popular in the context of Monte-Carlo simulations as they can effectively approximate target probability distributions, possibly alleviating some shortcomings of the Markov chain Monte-Carlo methods. Our package provides tools to create such samplers for two-dimensional field theories.
Mamba time series forecasting with uncertainty quantification
Authors: Pedro Pessoa, Paul Campitelli, Douglas P. Shepherd, S. Banu Ozkan, Steve Pressé
Date: 2025-03-13 00:00:00
Tasks: Mamba, Probabilistic Time Series Forecasting, State Space Models, Time Series, Time Series Forecasting, Uncertainty Quantification

State space models, such as Mamba, have recently garnered attention in time series forecasting due to their ability to capture sequence patterns. However, in electricity consumption benchmarks, Mamba forecasts exhibit a mean error of approximately 8\%. Similarly, in traffic occupancy benchmarks, the mean error reaches 18\%. This discrepancy leaves us to wonder whether the prediction is simply inaccurate or falls within error given spread in historical data. To address this limitation, we propose a method to quantify the predictive uncertainty of Mamba forecasts. Here, we propose a dual-network framework based on the Mamba architecture for probabilistic forecasting, where one network generates point forecasts while the other estimates predictive uncertainty by modeling variance. We abbreviate our tool, Mamba with probabilistic time series forecasting, as Mamba-ProbTSF and the code for its implementation is available on GitHub (https://github.com/PessoaP/Mamba-ProbTSF). Evaluating this approach on synthetic and real-world benchmark datasets, we find Kullback-Leibler divergence between the learned distributions and the data--which, in the limit of infinite data, should converge to zero if the model correctly captures the underlying probability distribution--reduced to the order of $10^{-3}$ for synthetic data and $10^{-1}$ for real-world benchmark, demonstrating its effectiveness. We find that in both the electricity consumption and traffic occupancy benchmark, the true trajectory stays within the predicted uncertainty interval at the two-sigma level about 95\% of the time. We end with a consideration of potential limitations, adjustments to improve performance, and considerations for applying this framework to processes for purely or largely stochastic dynamics where the stochastic changes accumulate, as observed for example in pure Brownian motion or molecular dynamics trajectories.