Stochastic dynamical low-rank approximation method

In this paper, we extend the dynamical low-rank approximation method to the space of finite signed measures. Under this framework, we derive stochastic low-rank dynamics for stochastic differential equations (SDEs) coming from classical stochastic dynamics or unraveling of Lindblad quantum master equations. We justify the proposed method by error analysis and also numerical examples for applications in solving high-dimensional SDE, stochastic Burgers' equation, and high-dimensional Lindblad equation.

Related papers:

title: A Survey of Model Reduction Methods for Large-Scale Systems
abstract: An overview of model reduction methods and a comparison of the resulting algorithms is presented. These approaches are divided into two broad categories, namely SVD based and moment matching based methods. It turns out that the approximation error in the former case behaves better globally in frequency while in the latter case the local behavior is better.

title: The quantum-state diffusion model applied to open systems
abstract: A model of a quantum system interacting with its environment is proposed in which the system is represented by a state vector that satisfies a stochastic differential equation, derived from a density operator equation such as the Bloch equation, and consistent with it. The advantages of the numerical solution of these equations over the direct numerical solution of the density operator equations are described. The method is applied to the nonlinear absorber, cascades of quantum transitions, second-harmonic generation and a measurement reduction process. The model provides graphic illustrations of these processes, with statistical fluctuations that mimic those of experiments. The stochastic differential equations originated from studies of the measurement problem in the foundations of quantum mechanics. The model is compared with the quantum-jump model of Dalibard (1992), Carmichael and others, which originated among experimenters looking for intuitive pictures and rules of computation.

title: Wave-function approach to dissipative processes in quantum optics.
abstract: A novel treatment of dissipation of energy from a "small" quantum system to a reservoir is presented. %'e replace the usual master equation for the small-system density matrix by a wave function evolution including a stochastic element. This wave-function approach provides new insight and it allows calculations on problems which would otherwise be exceedingly complicated. The approach is applied here to a two- or three-level atom coupled to a laser field and to the vacuum modes of the quantized electromagnetic field. PACS numbers: 42.50.— p, 32.80. — t A typical model system in quantum optics consists of an atom coupled simultaneously to a laser field and to the vacuum modes of the quantized electromagnetic field. The atom-laser interaction, responsible for absorption and stimulated emission processes, is coherent, whereas the coupling between the atom and the vacuum modes, responsible for spontaneous emission processes, is fundamentally incoherent. This leads to a dissipation of energy from the "small system" (atom+ laser) to the "reservoir" (vacuum field), which is usually treated by a density operator approach. A master equation, usually referred to as the optical Bloch equations (OBE's), is written for the reduced atomic density matrix pz . We present here an alternative approach using a wave-function treatment to describe the atomic system. The apparent incompatibility between such a wavefunction approach and the inherent irreversibility of the spontaneous processes is lifted by introducing repeated "gedanken measurements" on the atomic system simulating the detection of the spontaneous photons. The random result of each of these measurements determines the atomic state afterwards, and is at the origin of the irreversibility. We show that this treatment is equivalent to the standard density matrix approach leading to the OBE's. There are two main interests in this approach. First, it gives new insights into the processes taking place in the interaction of an atom with light. Here we will give two examples concerning the Rabi transitory regime for a two-level atom and the "dark resonance" problem. Second, it provides an efficient computational tool. If we consider an atomic system with N states, the master equation treatment requires the simultaneous solution of W OBE's, while in this new approach, we deal with wave functions and we have to look for the evolution of no more than W variables. For instance, in problems related to a quantum treatment of laser cooling, N includes both the number of internal and external atomic states and can be very large. This makes the density matrix approach unwieldy except for simple one-dimensional configuraI ttI(t+dt)) =I vr"'(t+dt))+

title: Molecular dynamics with electronic transitions
abstract: A method is proposed for carrying out molecular dynamics simulations of processes that involve electronic transitions. The time dependent electronic Schrodinger equation is solved self‐consistently with the classical mechanical equations of motion of the atoms. At each integration time step a decision is made whether to switch electronic states, according to probabilistic ‘‘fewest switches’’ algorithm. If a switch occurs, the component of velocity in the direction of the nonadiabatic coupling vector is adjusted to conserve energy. The procedure allows electronic transitions to occur anywhere among any number of coupled states, governed by the quantum mechanical probabilities. The method is tested against accurate quantal calculations for three one‐dimensional, two‐state models, two of which have been specifically designed to challenge any such mixed classical–quantal dynamical theory. Although there are some discrepancies, initial indications are encouraging. The model should be applicable to a wide variety of gas‐phase and condensed‐phase phenomena occurring even down to thermal energies.

title: Stochastic Processes and Applications: Diffusion Processes, the Fokker-Planck and Langevin Equations
abstract: Stochastic Processes.- Diffusion Processes.- Introduction to Stochastic Differential Equations.- The Fokker-Planck Equation.- Modelling with Stochastic Differential Equations.- The Langevin  Exit Problems for Diffusions.- Derivation of the Langevin Equation.- Linear Response Theory.- Appendix A Frequently Used Notations.- Appendix B Elements of Probability Theory.

title: On the generators of quantum dynamical semigroups
abstract: The notion of a quantum dynamical semigroup is defined using the concept of a completely positive map. An explicit form of a bounded generator of such a semigroup onB(ℋ) is derived. This is a quantum analogue of the Lévy-Khinchin formula. As a result the general form of a large class of Markovian quantum-mechanical master equations is obtained.

title: Completely Positive Dynamical Semigroups of N Level Systems
abstract: We establish the general form of the generator of a completely positive dynamical semigroup of an N‐level quantum system, and we apply the result to derive explicit inequalities among the physical parameters characterizing the Markovian evolution of a 2‐level system.

title: The Theory of Open Quantum Systems
abstract: PREFACE ACKNOWLEDGEMENTS PART 1: PROBABILITY IN CLASSICAL AND QUANTUM MECHANICS 1. Classical probability theory and stochastic processes 2. Quantum Probability PART 2: DENSITY MATRIX THEORY 3. Quantum Master Equations 4. Decoherence PART 3: STOCHASTIC PROCESSES IN HILBERT SPACE 5. Probability distributions on Hilbert space 6. Stochastic dynamics in Hilbert space 7. The stochastic simulation method 8. Applications to quantum optical systems PART 4: NON-MARKOVIAN QUANTUM PROCESSES 9. Projection operator techniques 10. Non-Markovian dynamics in physical systems PART 5: RELATIVISTIC QUANTUM PROCESSES 11. Measurements in relativistic quantum mechanics 12. Open quantum electrodynamics

title: Continuous measurements, quantum trajectories, and decoherent histories
abstract: Quantum open systems are described in the Markovian limit by master equations in Lindblad form. I argue that common ``quantum trajectory'' techniques representing continuous measurement schemes, which solve the master equation by unravelling its evolution into stochastic trajectories in Hilbert space, correspond closely to particular sets of decoherent (or consistent) histories. This is illustrated by a simple model of photon counting. An equivalence is shown for these models between standard quantum jumps and the orthogonal jumps of Di\'osi, which have already been shown to correspond to decoherent histories. This correspondence is compared to simple treatments of trajectories based on repeated or continuous measurements.

title: Dynamically orthogonal field equations for stochastic flows and particle dynamics
abstract: In the past decades an increasing number of problems in continuum theory have been treated using stochastic dynamical theories. This is because dynamical systems governing real processes always contain some elements characterized by uncertainty or stochasticity. Uncertainties may arise in the system parameters, the boundary and initial conditions, and also in the external forcing processes. Also, many problems are treated through the stochastic framework due to the incomplete or partial understanding of the governing physical laws. In all of the above cases the existence of random perturbations, combined with the complex dynamical mechanisms of the system often leads to their rapid growth which causes distribution of energy to a broadband spectrum of scales both in space and time, making the system state particularly complex. Such problems are mainly described by Stochastic Partial Differential Equations and they arise in a number of areas including fluid mechanics elasticity, and wave theory, describing phenomena such as turbulence, random vibrations, flow through porous media, and wave propagation through random media. This is but a partial listing of applications and it is clear that almost any phenomenon described by a field equation has an important subclass of problems that may profitably be treated from a stochastic point of view. In this work, we develop a new methodology for the representation and evolution of the complete probabilistic response of infinite-dimensional, random, dynamical systems. More specifically, we derive an exact, closed set of evolution equations for general nonlinear continuous stochastic fields described by a Stochastic Partial Differential Equation. The derivation is based on a novel condition, the Dynamical Orthogonality (DO), on the representation of the solution.

title: Dynamically orthogonal field equations for continuous stochastic dynamical systems
abstract: In this work we derive an exact, closed set of evolution equations for general continuous stochastic fields described by a Stochastic Partial Differential Equation (SPDE). By hypothesizing a decomposition of the solution field into a mean and stochastic dynamical component, we derive a system of field equations consisting of a Partial Differential Equation (PDE) for the mean field, a family of PDEs for the orthonormal basis that describe the stochastic subspace where the stochasticity ‘lives’ as well as a system of Stochastic Differential Equations that defines how the stochasticity evolves in the time varying stochastic subspace. These new evolution equations are derived directly from the original SPDE, using nothing more than a dynamically orthogonal condition on the representation of the solution. If additional restrictions are assumed on the form of the representation, we recover both the Proper Orthogonal Decomposition equations and the generalized Polynomial Chaos equations. We apply this novel methodology to two cases of two-dimensional viscous fluid flows described by the Navier–Stokes equations and we compare our results with Monte Carlo simulations.

title: Dynamical criteria for the evolution of the stochastic dimensionality in flows with uncertainty
abstract: We estimate and study the evolution of the dominant dimensionality of dynamical systems with uncertainty governed by stochastic partial differential equations, within the context of dynamically orthogonal (DO) field equations. Transient nonlinear dynamics, irregular data and non-stationary statistics are typical in a large range of applications such as oceanic and atmospheric flow estimation. To efficiently quantify uncertainties in such systems, it is essential to vary the dimensionality of the stochastic subspace with time. An objective here is to provide criteria to do so, working directly with the original equations of the dynamical system under study and its DO representation. We first analyze the scaling of the computational cost of these DO equations with the stochastic dimensionality and show that unlike many other stochastic methods the DO equations do not suffer from the curse of dimensionality. Subsequently, we present the new adaptive criteria for the variation of the stochastic dimensionality based on instantaneous (i) stability arguments and (ii) Bayesian data updates. We then illustrate the capabilities of the derived criteria to resolve the transient dynamics of two 2D stochastic fluid flows, specifically a double-gyre wind-driven circulation and a lid-driven cavity flow in a basin. In these two applications, we focus on the growth of uncertainty due to internal instabilities in deterministic flows. We consider a range of flow conditions described by varied Reynolds numbers and we study and compare the evolution of the uncertainty estimates under these varied conditions.

title: Error Analysis of the Dynamically Orthogonal Approximation of Time Dependent Random PDEs
abstract: In this work we discuss the dynamically orthogonal (DO) approximation of time dependent partial differential equations with random data. The approximate solution is expanded at each time instant on a time dependent orthonormal basis in the physical domain with a fixed and small number of terms. Dynamic equations are written for the evolution of the basis as well as the evolution of the stochastic coefficients of the expansion. We analyze the case of a linear parabolic equation with random data and derive a theoretical bound for the approximation error of the $S$-terms DO solution by the corresponding $S$-terms best approximation, i.e., the truncated $S$-terms Karhunen--Loeve expansion at each time instant. The bound is applicable on the largest time interval in which the best $S$-terms approximation is continuously time differentiable. Properties of the DO approximations are analyzed on simple cases of deterministic equations with random initial data. Numerical tests are presented that confirm the theoret...

title: A dynamically bi-orthogonal method for time-dependent stochastic partial differential equations II: Adaptivity and generalizations
abstract: This is part II of our paper in which we propose and develop a dynamically bi-orthogonal method (DyBO) to study a class of time-dependent stochastic partial differential equations (SPDEs) whose solutions enjoy a low-dimensional structure. In part I of our paper , we derived the DyBO formulation and proposed numerical algorithms based on this formulation. Some important theoretical results regarding consistency and bi-orthogonality preservation were also established in the first part along with a range of numerical examples to illustrate the effectiveness of the DyBO method. In this paper, we focus on the computational complexity analysis and develop an effective adaptivity strategy to add or remove modes dynamically. Our complexity analysis shows that the ratio of computational complexities between the DyBO method and a generalized polynomial chaos method (gPC) is roughly of order O((m/N"p)^3) for a quadratic nonlinear SPDE, where m is the number of mode pairs used in the DyBO method and N"p is the number of elements in the polynomial basis in gPC. The effective dimensions of the stochastic solutions have been found to be small in many applications, so we can expect m is much smaller than N"p and computational savings of our DyBO method against gPC are dramatic. The adaptive strategy plays an essential role for the DyBO method to be effective in solving some challenging problems. Another important contribution of this paper is the generalization of the DyBO formulation for a system of time-dependent SPDEs. Several numerical examples are provided to demonstrate the effectiveness of our method, including the Navier-Stokes equations and the Boussinesq approximation with Brownian forcing.

title: Dynamical Low-Rank Approximation
abstract: For the low-rank approximation of time-dependent data matrices and of solutions to matrix differential equations, an increment-based computational approach is proposed and analyzed. In this method, the derivative is projected onto the tangent space of the manifold of rank-$r$ matrices at the current approximation. With an appropriate decomposition of rank-$r$ matrices and their tangent matrices, this yields nonlinear differential equations that are well suited for numerical integration. The error analysis compares the result with the pointwise best approximation in the Frobenius norm. It is shown that the approach gives locally quasi-optimal low-rank approximations. Numerical experiments illustrate the theoretical results.

title: Low-rank numerical approximations for high-dimensional Lindblad equations
abstract: A systematic numerical approach to approximate high-dimensional Lindblad equations is described. It is based on a deterministic rank m approximation of the density operator, the rank m being the only parameter to adjust. From a known initial density operator, this rank m approximation gives at each time step an estimate of its largest m eigenvalues with their associated eigenvectors. A numerical integration scheme is also proposed. Its numerical efficiency in the case of a rank m=12 approximation is demonstrated for oscillation revivals of 50 atoms interacting resonantly with a slightly damped coherent quantized field of 200 photons.

title: Adaptive low-rank approximation and denoised Monte Carlo approach for high-dimensional Lindblad equations
abstract: We present a twofold contribution to the numerical simulation of Lindblad equations. First, an adaptive numerical approach to approximate Lindblad equations using low-rank dynamics is described: a deterministic low-rank approximation of the density operator is computed, and its rank is adjusted dynamically, using an on-the-fly estimator of the error committed when reducing the dimension. On the other hand, when the intrinsic dimension of the Lindblad equation is too high to allow for such a deterministic approximation, we combine classical ensemble averages of quantum Monte Carlo trajectories and a denoising technique. Specifically, a variance reduction method based upon the consideration of a low-rank dynamics as a control variate is developed. Numerical tests for quantum collapse and revivals show the efficiency of each approach, along with the complementarity of the two approaches.

title: Gradient Flows: In Metric Spaces and in the Space of Probability Measures
abstract: Gradient Flow in Metric Spaces.- Curves and Gradients in Metric Spaces.- Existence of Curves of Maximal Slope and their Variational Approximation.- Proofs of the Convergence Theorems.- Uniqueness, Generation of Contraction Semigroups, Error Estimates.- Gradient Flow in the Space of Probability Measures.- Preliminary Results on Measure Theory.- The Optimal Transportation Problem.- The Wasserstein Distance and its Behaviour along Geodesics.- Absolutely Continuous Curves in ) and the Continuity Equation.- Convex Functionals in p(X).- Metric Slope and Subdifferential Calculus in (X).- Gradient Flows and Curves of Maximal Slope in ).

title: On tangent cones in Wasserstein space
abstract: If M is a smooth compact Riemannian manifold, let P(M) denote the Wasserstein space of probability measures on M. If S is an embedded submanifold of M, and $\mu$ is an absolutely continuous measure on S, then we compute the tangent cone of P(M) at $\mu$.

title: Runge-Kutta type methods for orthogonal integration
abstract: A simple characterisation exists for the class of real-valued, autonomous, matrix ODEs where an orthogonal initial condition implies orthogonality of the solution for all time. Here we present first and second order numerical methods for which the property of orthogonality-preservation is always carried through to the discrete approximation. To our knowledge, these are the first methods that guarantee to preserve orthogonality, without the use of projection, whenever it is preserved by the flow. The methods are based on Gauss-Legendre Runge-Kutta formulas, which are known to preserve orthogonality on a restricted problem class. In addition, the new methods are linearly-implicit, requiring only the solution of one or two linear matrix systems (of the same dimension as the solution matrix) per step. Illustrative numerical tests are reported.

title: A robust bi-orthogonal/dynamically-orthogonal method using the covariance pseudo-inverse with application to stochastic flow problems
abstract: We develop a new robust methodology for the stochastic Navier–Stokes equations based on the dynamically-orthogonal (DO) and bi-orthogonal (BO) methods  ,  ,  . Both approaches are variants of a generalized Karhunen–Loeve (KL) expansion in which both the stochastic coefficients and the spatial basis evolve according to system dynamics, hence, capturing the low-dimensional structure of the solution. The DO and BO formulations are mathematically equivalent [3] , but they exhibit computationally complimentary properties. Specifically, the BO formulation may fail due to crossing of the eigenvalues of the covariance matrix, while both BO and DO become unstable when there is a high condition number of the covariance matrix or zero eigenvalues. To this end, we combine the two methods into a robust hybrid framework and in addition we employ a pseudo-inverse technique to invert the covariance matrix. The robustness of the proposed method stems from addressing the following issues in the DO/BO formulation: (i) eigenvalue crossing: we resolve the issue of eigenvalue crossing in the BO formulation by switching to the DO near eigenvalue crossing using the equivalence theorem and switching back to BO when the distance between eigenvalues is larger than a threshold value; (ii) ill-conditioned covariance matrix: we utilize a pseudo-inverse strategy to invert the covariance matrix; (iii) adaptivity: we utilize an adaptive strategy to add/remove modes to resolve the covariance matrix up to a threshold value. In particular, we introduce a soft-threshold criterion to allow the system to adapt to the newly added/removed mode and therefore avoid repetitive and unnecessary mode addition/removal. When the total variance approaches zero, we show that the DO/BO formulation becomes equivalent to the evolution equation of the Optimally Time-Dependent modes  . We demonstrate the capability of the proposed methodology with several numerical examples, namely (i) stochastic Burgers equation: we analyze the performance of the method in the presence of eigenvalue crossing and zero eigenvalues; (ii) stochastic Kovasznay flow: we examine the method in the presence of a singular covariance matrix; and (iii) we examine the adaptivity of the method for an incompressible flow over a cylinder where for large stochastic forcing thirteen DO/BO modes are active.

title: A dynamical polynomial chaos approach for long-time evolution of SPDEs
abstract: We propose a Dynamical generalized Polynomial Chaos (DgPC) method to solve time-dependent stochastic partial differential equations (SPDEs) with white noise forcing. The long-time simulation of SPDE solutions by Polynomial Chaos (PC) methods is notoriously difficult as the dimension of the stochastic variables increases linearly with time. Exploiting the markovian property of white noise, DgPC  implements a restart procedure that allows us to expand solutions at future times in terms of orthogonal polynomials of the measure describing the solution at a given time and the future white noise. The dimension of the representation is kept minimal by application of a Karhunen--Loeve (KL) expansion. Using frequent restarts and low degree polynomials on sparse multi-index sets, the method allows us to perform long time simulations, including the calculation of invariant measures for systems which possess one. We apply the method to the numerical simulation of stochastic Burgers and Navier--Stokes equations with white noise forcing. Our method also allows us to incorporate time-independent random coefficients such as a random viscosity. We propose several numerical simulations and show that the algorithm compares favorably with standard Monte Carlo methods.