# Stable Sequential Pontryagin Maximum Principle as a Tool for Solving Unstable Optimal Control and Inverse Problems for Distributed Systems

Mikhail Sumin

► To cite this version:

Mikhail Sumin. Stable Sequential Pontryagin Maximum Principle as a Tool for Solving Unstable Optimal Control and Inverse Problems for Distributed Systems. 27th IFIP Conference on System Modeling and Optimization (CSMO), Jun 2015, Sophia Antipolis, France. pp.482-492, 10.1007/978-3-319-55795-3_46. hal-01626924

HAL Id: hal-01626924

https://inria.hal.science/hal-01626924

Submitted on 31 Oct 2017

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Stable Sequential Pontryagin Maximum Principle as a Tool for Solving Unstable Optimal Control and Inverse Problems for Distributed Systems

Mikhail Sumin

Faculty of Mechanics and Mathematics, Nizhnii Novgorod State University,
Gagarin Ave. 23, 603950 Nizhnii Novgorod, Russia
m.sumin@mail.ru

**Abstract.** This article is devoted to studying dual regularization method as applied to parametric convex optimal control problem of controlled third boundary-value problem for parabolic equation with boundary control and with equality and inequality pointwise state constraints. These constraints are understood as ones in the Hilbert space $L_2$. A major advantage of the constraints of the original problem which are understood as ones in $L_2$ is that the resulting dual regularization algorithm is stable with respect to errors in the input data and leads to the construction of a minimizing approximate solution in the sense of J. Warga. Simultaneously, this dual algorithm yields the corresponding necessary and sufficient conditions for minimizing sequences, namely, the stable, with respect to perturbation of input data, sequential or, in other words, regularized Lagrange principle in nondifferential form and Pontryagin maximum principle for the original problem. Regardless of the fact that the stability or instability of the original optimal control problem, they stably generate a minimizing approximate solutions for it. For this reason, we can interpret these regularized Lagrange principle and Pontryagin maximum principle as tools for direct solving unstable optimal control problems and reducing to them unstable inverse problems.

**Keywords:** Optimal boundary control, parabolic equation, minimizing sequence, dual regularization, stability, Pontryagin maximum principle

## 1 Introduction

Pontryagin maximum principle is the central result of all optimal control theory, including optimal control for differential equations with partial derivatives. Its statement and proof assume, first of all, that the optimal control problem is considered in an ideal situation, when its input data are known exactly. However, in the vast number of important practical problems of optimal control, as well as numerous problems reducing to optimal control problems, the requirement of exact defining input data is very unnatural, and in many undoubtedly interest
cases is simply impracticable. In similar problems, we can not, strictly speaking, to take as an approximation to the solution of the initial (unperturbed) problem with the exact input data, a control formally satisfying the maximum principle in the perturbed problem. The reason of such situation lies in the natural instability of optimization problems with respect to perturbation of its input data. As a typical property of optimization problems in general, including constrained ones, instability fully manifests itself in optimal control problems (see., e.g., [1]). As a consequence, the mentioned above instability implies “instability” of the classical optimality conditions, including the conditions in the form of Pontryagin maximum principle. This instability manifests itself in selecting by them of arbitrarily distant “perturbed” optimal elements from their unperturbed counterparts in the case of an arbitrarily small perturbations of the input data. The above applies, in full measure, both to discussed below optimal control problem with pointwise state constraints for linear parabolic equation in divergent form, and to the classical optimality conditions in the form of the Lagrange principle and the Pontryagin maximum principle for this problem.

In this paper we discuss how to overcome the problem of instability of the classical optimality conditions in optimal control problems in the way of applying dual regularization method (see., e.g., [2–4]) and simultaneous transition to the concept of minimizing sequence of admissible elements as the main concept of optimization theory. In the role of the last, acts the concept of the minimizing approximate solution in the sense of J.Warga [5]. The main attention in the paper is given to the discussion of the so-called regularized or, in other words, stable, with respect to perturbation of input data, sequential Lagrange principle in the nondifferential form and Pontryagin maximum principle. Regardless of the stability or instability of the original optimal control problem, they stably generate minimizing approximate solutions for it. For this reason, we can interpret the regularized Lagrange principle and Pontryagin maximum principle that are obtained in the article as tools for direct solving unstable optimal control problems and reducing to them unstable inverse problems [1, 6, 7]. Thus, they contribute to a significant expansion of the range of applicability of the theory of optimal control in which a central role belongs to classic constructions of the Lagrange and Hamilton-Pontryagin functions. Finally, we note that discussed in this article regularized Lagrange principle in the nondifferential form and Pontryagin maximum principle may have another kind, more convenient for applications [7]. Justification of these alternative forms of the regularized Lagrange principle and Pontryagin maximum principle is based on the so-called method of iterative dual regularization [2, 3]. In this case, they take the form of iterative processes with the corresponding stopping rules when the error of input data is fixed and finite. Here these alternative forms are not considered.

## 2 Statement of Optimal Control Problem

We consider the fixed-time parametric optimal control problem

$$ (P_{p,r}^{\delta}) \qquad g_{0}^{\delta}(\pi) \rightarrow \min, \quad \pi \equiv (u, w) \in \mathcal{D} \subset L_{2}(Q_{T}) \times L_{2}(S_{T}), $$
$$g_1^\delta(\pi)(x,t) \equiv \varphi_1^\delta(x,t)z^\delta[\pi](x,t) = h^\delta(x,t) + p(x,t) \quad \text{for a.e. } (x,t) \in Q,$$

$$g_2^\delta(\pi)(x,t) \equiv \varphi_2^\delta(x,t, z^\delta[\pi](x,t)) \leq r(x,t) \quad \text{for a.e. } (x,t) \in Q$$

with equality and inequality pointwise state constraints understood as ones in the Hilbert space $\mathcal{H} \equiv L_2(Q)$; $\mathcal{D} \equiv \{u \in L_2(Q_T) : u(x,t) \in U \text{ for a.e. } (x,t) \in Q_T\} \times \{w \in L_2(S_T) : w(x,t) \in W \text{ for a.e. } (x,t) \in S_T\}$; $U, W \subset \mathbb{R}^1$ are convex compact sets. In this problem, $p \in \mathcal{H}$ and $r \in \mathcal{H}$ are parameters; $g_0^\delta : L_2(Q_T) \times L_2(S_T)$ is a continuous convex functional, $Q \subset \bar{Q}_{i,T}$ is a compact set without isolated points with a nonempty interior, $\iota \in (0, T)$, $Q = \text{cl int}Q$; and $z^\delta[\pi] \in V_2^{1,0}(Q_T) \cap C(\bar{Q}_T)$ is a weak solution [8, 9] to the third boundary-value problem<fnref n="1" />

$$z_t - \frac{\partial}{\partial x_i}(a_{i,j}(x,t)z_{x_j}) + a^\delta(x,t)z + u(x,t) = 0, \quad (1)$$

$$z(x, 0) = v_0^\delta(x), \quad x \in \Omega, \quad \frac{\partial z}{\partial \mathcal{N}} + \sigma^\delta(x,t)z = w(x,t), \quad (x,t) \in S_T,$$

corresponding to the pair $\pi \equiv (u, w)$. The superscript $\delta$ in the input data of Problem $(P_{p,r}^\delta)$ indicates that these data are exact ($\delta = 0$) or perturbed ($\delta > 0$), i.e., they are specified with an error, $\delta \in [0, \delta_0]$, where $\delta_0 > 0$ is a fixed number. For definiteness, as target functional we take terminal one

$$g_0^\delta(\pi) \equiv \int_{\Omega} G^\delta(x, z^\delta[\pi](x, T)) dx.$$

The input data for Problem $(P_{p,r}^0)$ are assumed to meet the following conditions:

a) It is true that $a_{i,j} \in L_\infty(Q_T)$, $i, j = 1, \dots, n$, $a^\delta \in L_\infty(Q_T)$, $\sigma^\delta \in L_\infty(S_T)$, $v_0^\delta \in C(\bar{\Omega})$,

$$\nu|\xi|^2 \leq a_{i,j}(x,t)\xi_i\xi_j \leq \mu|\xi|^2 \quad \forall (x,t) \in Q_T, \quad \nu, \mu > 0,$$

$$a^\delta(x,t) \geq C_0 \quad \text{for a.e. } (x,t) \in Q_T, \quad \sigma^\delta(x,t) \geq C_0 \quad \text{for a.e. } (x,t) \in S_T;$$

b) It is true that $\varphi_1^\delta, h^\delta \in L_\infty(Q)$; $\varphi_2^\delta : Q \times \mathbb{R}^1 \to \mathbb{R}^1$ is Lebesgue measurable function that is continuous and convex with respect to $z$ for a.e. $(x,t) \in Q$, $\varphi_2^\delta(\cdot, \cdot, z(\cdot, \cdot)) \in L_\infty(Q) \forall z \in C(Q)$; $G^\delta : \Omega \times \mathbb{R}^1 \to \mathbb{R}^1$ is Lebesgue measurable function that is continuous and convex with respect to $z$ for a.e. $x \in \Omega$, $G^\delta(\cdot, z(\cdot, T)) \in L_\infty(\Omega) \forall z(\cdot, T) \in C(Q)$;

c) $\Omega \subset \mathbb{R}^n$ be a bounded domain with Lipschitz boundary $S$.

Assume that the following estimates hold:

$$|G^\delta(x, z) - G^0(x, z)| \leq C_M \delta \quad \forall (x, z) \in \Omega \times S_M^1, \quad \|\varphi_1^\delta - \varphi_1^0\|_{\infty, Q} \leq C\delta, \quad (2)$$

$$\|h^\delta - h^0\|_{\infty, Q} \leq C\delta, \quad |\varphi_2^\delta(x, t, z) - \varphi_2^0(x, t, z)| \leq C_M\delta \quad \forall (x, t, z) \in Q \times S_M^1,$$

<footnote n="1">¹ Here and below, we use the notations for the sets $Q_T$, $S_T$, $Q_{i,T}$ and also for functional spaces and norms of their elements adopted in monograph [8].</footnote>
$$
\|a^{\delta} - a^{0}\|_{\infty, Q_{T}} \leq C\delta, \quad |v_{0}^{\delta} - v_{0}|_{\Omega}^{(0)} \leq C\delta, \quad \|\sigma^{\delta} - \sigma^{0}\|_{\infty, S_{T}} \leq C\delta,
$$

where $C, C_M > 0$ are independent of $\delta$; $S_M^n = \{x \in \mathbb{R}^n : |x| < M\}$. Let's note,
that the conditions on the input data of Problem $(P_{p,r}^\delta)$, and also the estimates
of deviations of the perturbed input data from the exact ones can be weakened.

In this paper we use for discussing the main results, related to the stable
sequential Lagrange principle and Pontryagin maximum principle in Problem
$(P_{p,r}^0)$, a scheme of studying the similar optimization problems in the papers [10,
11] for a system of controlled ordinary differential equations. In these works, both
spaces of admissible controls and spaces, where lie images of the operators that
define the pointwise state constraints, represented as Hilbert spaces of square-
integrable functions. For this reason, we put the set $\mathcal{D}$ of admissible controls
$\pi$ into a Hilbert space also, i.e., assume that $\mathcal{D} \subset Z \equiv L_2(Q_T) \times L_2(S_T)$,
$\|\pi\| = (\|u\|_{2,Q_T}^2 + \|w\|_{2,S_T}^2)^{1/2}$. At the same time, we note that the conditions on
the input data of Problem $(P_{p,r}^\delta)$ allow formally to consider that the operators
$g_1^\delta, g_2^\delta$, specifying the state constraints of the problem, act into space $L_p(Q)$ with
any index $p \in [1, +\infty]$. However, in this paper, taking into account the above
remark, we will put images of these functional operators in the Hilbert space
$L_2(Q) \equiv \mathcal{H}$.

Suppose that Problem $(P_{p,r}^0)$ has a solution (which is unique if $g_0^0$ is strictly (strongly) convex). Its solutions are denoted by $\pi_{p,r}^0 \equiv (u_{p,r}^0, w_{p,r}^0)$, and the set of all such solutions is designated as $U_{p,r}^0$. Define the Lagrange functional, a set of its minimizers and the concave dual problem

$$
L_{p,r}^{\delta}(\pi, \lambda, \mu) \equiv g_{0}^{\delta}(\pi) + \langle \lambda, g_{1}^{\delta}(\pi) - h^{\delta} - p \rangle + \langle \mu, g_{2}^{\delta}(\pi) - r \rangle, \pi \in \mathcal{D},
$$

$$
U^{\delta}[\lambda, \mu] \equiv \operatorname{Argmin} \{L_{p,r}^{\delta}(\pi, \lambda, \mu) : \pi \in \mathcal{D}\} \quad \forall (\lambda, \mu) \in \mathcal{H} \times \mathcal{H}_{+},
$$

$$
V_{p,r}^{\delta}(\lambda, \mu) \to \sup, \quad (\lambda, \mu) \in \mathcal{H} \times \mathcal{H}_{+}, \quad V_{p,r}^{\delta}(\lambda, \mu) \equiv \inf_{\pi \in \mathcal{D}} L_{p,r}^{\delta}(\pi, \lambda, \mu).
$$

Since the Lagrange functional is continuous and convex for any pair $(\lambda, \mu) \in \mathcal{H} \times \mathcal{H}_+$ and the set $\mathcal{D}$ is bounded, the dual functional $V_{p,r}^{\delta}$, is obviously defined and finite for any $(\lambda, \mu) \in \mathcal{H} \times \mathcal{H}_+$.

The concept of a minimizing approximate solution in the sense of J.Warga
[5] is of great importance for the design of a dual regularizing algorithm for
problem $(P_{p,r}^0)$. Recall that a minimizing approximate solution is a sequence
$\pi^i \equiv (u^i, w^i)$, $i = 1, 2, \dots$ such that $g_0^0(\pi^i) \le \beta(p,r) + \delta^i$, $\pi^i \in \mathcal{D}_{p,r}^{0,\epsilon}$ for some
nonnegative number sequences $\delta^i$ and $\epsilon^i$, $i = 1, 2, \dots$, that converge to zero.
Here, $\beta(p,r)$ is the generalized infimum, i.e., an $S$-function:

$$
\beta(p,r) \equiv \lim_{\epsilon \to +0} \beta_{\epsilon}(p,r), \quad \beta_{\epsilon}(p,r) \equiv \inf_{\pi \in \mathcal{D}_{p,r}^{0,\epsilon}} g_{0}^{0}(\pi), \quad \beta_{\epsilon}(p,r) \equiv +\infty \text{ if } \mathcal{D}_{p,r}^{0,\epsilon} = \emptyset,
$$

$$
\mathcal{D}_{p,r}^{\delta, \epsilon} \equiv \{ \pi \in \mathcal{D} : \|g_1^\delta(\pi) - h^\delta - p\|_{2,Q} \le \epsilon, \min_{z \in \mathcal{H}_-} \|g_2^\delta(\pi) - r - z\|_{2,Q} \le \epsilon \}, \epsilon \ge 0,
$$

$$
\mathcal{D}_{p,r}^{00} \equiv \mathcal{D}_{p,r}^{0}, \quad \mathcal{H}_{-} \equiv \{z \in L_2(Q) : z(x,t) \le 0 \text{ for a.e. } (x,t) \in Q\}, \quad \mathcal{H}_{+} \equiv -\mathcal{H}_{-}.
$$
Obviously, in the general situation, $\beta(p,r) \le \beta_0(p,r)$, where $\beta_0(p,r)$ is the classical value of the problem. However, in the case of Problem $(P_{p,r}^0)$, we have $\beta(p,r) = \beta_0(p,r)$. Simultaneously, we may asset that $\beta : L_2(Q) \times L_2(Q) \to \mathbb{R}^1 \cup \{+\infty\}$ is a convex and lower semicontinuous function. Note here that the existence of a minimizing approximate solution in Problem $(P_{p,r}^0)$ obviously implies its solvability.

From the conditions a) – c) and the theorem on the existence of a weak solution of the third boundary-value problem for a linear parabolic equation of the divergent type (see [8, ch. III, section 5] and also [12]), it follows that the direct boundary-value problem (1) and the corresponding adjoint problem are uniquely solvable in $V_2^{1,0}(Q_T)$.

**Proposition 1.** For any pair $(u, w) \in L_2(Q_T) \times L_2(S_T)$ and any $T > 0$ the direct boundary-value problem (1) is uniquely solvable in $V_2^{1,0}(Q_T)$ and the estimate

$$|z^{\delta}[\pi]|_{Q_T} + \|z^{\delta}[\pi]\|_{2,S_T} \le C_T(\|u\|_{2,Q_T} + \|v_0^{\delta}\|_{2,\Omega} + \|w\|_{2,S_T}),$$

takes place, where the constant $C_T$ is independent of $\delta \ge 0$ and pair $\pi = (u, w) \in L_2(Q_T) \times L_2(S_T)$. Also the adjoint problem

$$-\eta_t - \frac{\partial}{\partial x_j} a_{i,j}(x,t)\eta_{x_i} + a^{\delta}(x,t)\eta = \chi(x,t),$$

$$\eta(x, T) = \psi(x), x \in \Omega, \quad \frac{\partial \eta}{\partial \mathcal{N}} + \sigma^{\delta}(x, t)\eta = \omega(x, t), (x, t) \in S_T$$

is uniquely solvable in $V_2^{1,0}(Q_T)$ for any $\chi \in L_2(Q_T)$, $\psi \in L_2(\Omega)$, $\omega \in L_2(S_T)$ and any $T > 0$. Its solution is denoted as $\eta[\chi, \psi, \omega]$. Simultaneously, the estimate

$$|\eta^{\delta}[\chi, \psi, \omega]|_{Q_T} + \|\eta^{\delta}[\chi, \psi, \omega]\|_{2,S_T} \le C_T^1(\|\chi\|_{2,Q_T} + \|\psi\|_{2,\Omega} + \|\omega\|_{2,S_T}),$$

is true, where the constant $C_T^1$ is independent of $\delta \ge 0$ and a triple $(\chi, \psi, \omega)$.

Simultaneously, from conditions a) – c) and the theorems on the existence of a weak (generalized) solution of the third boundary-value problem for a linear parabolic equation of the divergent type (see, e.g., [9]), it follows that the direct boundary-value problem is uniquely solvable in $V_2^{1,0}(Q_T) \cap C(\bar{Q}_T)$.

**Proposition 2.** Let us $l > n + 1$. For any pair $(u, w) \in L_l(Q_T) \times L_l(S_T)$ and any $T > 0$, $\delta \in [0, \delta_0]$ the direct boundary-value problem (1) is uniquely solvable in $V_2^{1,0}(Q_T) \cap C(\bar{Q}_T)$ and the estimate

$$|z^{\delta}[\pi]|_{\bar{Q}_T}^{(0)} \le C_T(\|u\|_{l,Q_T} + |v_0^{\delta}|_{\bar{Q}}^{(0)} + \|w\|_{l,S_T}),$$

takes place, where the constant $C_T$ is independent of pair $\pi = (u, w)$ and $\delta$.

Further, the minimization problem for Lagrange functional

$$L_{p,r}^{\delta}(\pi, \lambda, \mu) \to \min, \pi \in \mathcal{D} \quad \text{when } (\lambda, \mu) \in L_2(Q) \times L_2^+(Q) \quad (3)$$
plays the central role in all subsequent constructions. It is usual problem without equality and inequality constraints. It is solvable as a minimization problem for weakly semicontinuous functional on the weak compact set $\mathcal{D} \subset L_2(Q_T) \times L_2(S_T)$. Here, the weak semicontinuity is a consequence of the convexity and continuity with respect to $\pi$ of the Lagrange functional. Minimizers $\pi^\delta[\lambda, \mu] \in U^\delta[\lambda, \mu]$ for this optimal control problem satisfy the Pontryagin maximum principle under supplementary assumption of the existence of Lebesgue measurable with respect to $(x, t) \in Q$ for all $z \in \mathbb{R}^1$ and continuous with respect to $z$ for a.e. $x, t$ gradients $\nabla_z\varphi_2^\delta(x, t, z)$, $\nabla_zG^\delta(x, z)$ with the estimates $|\nabla_z\varphi_2^\delta(x, t, z)| \le C_M$, $|\nabla_zG^\delta(x, z)| \le C_M \forall z \in S_M^1$ where $C_M > 0$ is independent of $\delta$. Due to the estimates of the propositions 1, 2 and to the so called two-parameter variation [13] of the pair $\pi^\delta[\lambda, \mu]$ that is needle-shaped with respect to control $u$ and classical with respect to control $w$ the following lemma is true.

**Lemma 1.** Let $H(y, \eta) \equiv -\eta y$ and the additional condition that specified above is fulfilled. Any pair $\pi^\delta[\lambda, \mu] = (u^\delta[\lambda, \mu], w^\delta[\lambda, \mu]) \in U^\delta[\lambda, \mu]$, $(\lambda, \mu) \in L_2(Q) \times L_2^+(Q)$ satisfies to (usual) Pontryagin maximum principle in the problem (3): for $\pi = \pi^\delta[\lambda, \mu]$ the following maximum relations

$$H(u(x, t), \eta^\delta(x, t)) = \max_{u \in U} H(u, \eta^\delta(x, t)) \quad \text{for a.e. } Q_T, \quad (4)$$

$$H(w(s, t), \eta^\delta(s, t)) = \max_{w \in W} H(w, \eta^\delta(s, t)) \quad \text{for a.e. } S_T$$

hold, where $\eta^\delta(x, t)$, $(x, t) \in Q_T$ is a solution for $\pi = \pi^\delta[\lambda, \mu]$ of the adjoint problem

$$-\eta_t - \frac{\partial}{\partial x_j}(a_{i,j}(x,t)\eta_{x_i}) + a^\delta(x,t)\eta =$$

$$\varphi_1^\delta(x, t)\lambda(x, t) + \nabla_z\varphi_2^\delta(x, t, z^\delta[\pi](x, t))\mu(x, t), \quad (x, t) \in Q_T,$$

$$\eta(x, T) = \nabla_z G^\delta(x, z^\delta[\pi](x, T)), \quad x \in \Omega, \quad \frac{\partial \eta(x, t)}{\partial \mathcal{N}} + \sigma^\delta(x, t)\eta = 0, \quad (x, t) \in S_T.$$

**Remark 1.** Note that here and below, if the functions $\varphi_1^\delta$, $\nabla_z\varphi_2^\delta(\cdot, \cdot, z(\cdot, \cdot))$, $\lambda, \mu \in L_2(Q)$ are considered on the entire cylinder $Q_T$, we set that the equalities $\varphi_1^\delta(x, t) = \nabla_z\varphi_2^\delta(x, t, z(x, t)) = \lambda(x, t) = \mu(x, t) = 0$ take place for $(x, t) \in Q_T \setminus Q$; the same notation is preserved if these functions are taken on the entire cylinder.

In the next section we construct minimizing approximate solutions for Problem $(P_{p,r}^0)$ from the elements $\pi^\delta[\lambda, \mu]$, $(\lambda, \mu) \in L_2(Q) \times L_2^+(Q)$. As consequence, this construction leads us to various versions of the stable sequential Lagrange principle and Pontragin maximum principle. In the case of strong convexity and subdifferentiability of the target functional $g_0^0$, these versions are statements about stable approximations of the solutions of Problem $(P_{p,r}^0)$ in the metric of $Z \equiv L_2(Q_T) \times L_2(S_T)$ by the points $\pi^\delta[\lambda, \mu]$. Due to the estimates (2) and the propositions 1, 2 we may assert that the estimates

$$|g_0^\delta(\pi) - g_0^0(\pi)| \le C_1\delta \quad \forall \pi \in \mathcal{D}, \quad \|g_1^\delta(\pi) - g_1^0(\pi)\|_{2,Q} \le C_2\delta(1 + \|\pi\|) \quad \forall \pi \in Z, \quad (5)$$

$$\|h^\delta - h^0\|_{2,Q} \le C\delta, \quad \|g_2^\delta(\pi) - g_2^0(\pi)\|_{2,Q} \le C_3\delta \quad \forall \pi \in \mathcal{D},$$

hold, in which the constants $C_1, C_2, C_3 > 0$ are independent of $\delta \in (0, \delta_0], \pi$.
# 3 Stable Sequential Pontryagin Maximum Principle

In this section we discuss the so-called regularized or, in other words, stable, with respect errors of input data, sequential Pontryagin maximum principle for Problem ($P_{p,r}^0$) as necessary and sufficient condition for elements of minimizing approximate solutions. Simultaneously, this condition we may treat as one for existence of a minimizing approximate solutions in Problem ($P_{p,r}^0$) with perturbed input data or as condition of stable construction of a minimizing sequence in this problem. The proof of the necessity of this condition is based on the dual regularization method [2–4] that is stable algorithm of constructing a minimizing approximate solutions in Problem ($P_{p,r}^0$). Sketches of the proofs for the theorems in this section (Theorems 1, 2, 3) and some comments may be found in [14, 15].

## 3.1 Dual Regularization for Optimal Control Problem with Pointwise State Constraints

The estimates (5) give a possibility to organize for constructing a minimizing approximate solution in Problem ($P_{p,r}^0$) the procedure of the dual regularization in accordance with a scheme of the paper [11]. In accordance with this scheme the dual regularization consists in the direct solving dual problem to Problem ($P_{p,r}^0$) and its Tikhonov stabilization

$$R_{p,r}^{\delta,\alpha(\delta)}(\lambda, \mu) \equiv V_{p,r}^{\delta}(\lambda, \mu) - \alpha(\delta) \|(\lambda, \mu)\|^2 \to \max, \quad (\lambda, \mu) \in L_2(Q) \times L_2^+(Q)$$

under consistency condition $\delta/\alpha(\delta) \to 0$, $\alpha(\delta) \to 0$, $\delta \to 0$. This dual regularization leads to constructing minimizing approximate solution in Problem ($P_{p,r}^0$) from the elements $\pi^\delta[\lambda_{p,r}^{\delta,\alpha(\delta)}, \mu_{p,r}^{\delta,\alpha(\delta)}] \in \text{Argmin}\{L_{p,r}^\delta(\pi, \lambda, \mu) : \pi \in \mathcal{D}\}$, where $(\lambda_{p,r}^{\delta,\alpha}, \mu_{p,r}^{\delta,\alpha}) = \text{argmax}\{R_{p,r}^{\delta,\alpha}(\lambda, \mu) : (\lambda, \mu) \in L_2(Q) \times L_2^+(Q)\}$ and $\delta \to 0$.

We may assert that the following “convergence” theorem for the dual regularization method in Problem ($P_{p,r}^0$) is valid.

**Theorem 1.** Regardless of the properties of the solvability of the dual problem to Problem ($P_{p,r}^0$) or, in other words, regardless of the properties of the sub-differential $\partial\beta(p,r)$ (it is empty or not empty), it is true that exist elements $\pi^\delta \in U^\delta[\lambda_{p,r}^{\delta,\alpha(\delta)}, \mu_{p,r}^{\delta,\alpha(\delta)}]$ such that the relations

$$g_0^0(\pi^\delta) \to g_0^0(\pi_{p,r}^0), \quad g_1^0(\pi^\delta) - h^0 - p \to 0, \quad g_2^0(\pi^\delta) - r \le \kappa(\delta), \quad \|\kappa(\delta)\| \to 0, \quad \delta \to 0,$$

$$\langle (\lambda_{p,r}^{\delta,\alpha(\delta)}, \mu_{p,r}^{\delta,\alpha(\delta)}), (g_1^{\delta}(\pi^{\delta}) - h^{\delta} - p, g_2^{\delta}(\pi^{\delta}) - r) \rangle \to 0, \quad \delta \to 0$$

hold, in which the inequality $g_2^0(\pi^\delta) - r \le \kappa(\delta)$ is understood in the sense of ordering on a cone of nonpositive functions in $L_2(Q)$. Simultaneously, the equality

$$\lim_{\delta \to 0+} V_{p,r}^0(\lambda_{p,r}^{\delta,\alpha(\delta)}, \mu_{p,r}^{\delta,\alpha(\delta)}) = \sup_{(\lambda,\mu) \in \mathcal{H} \times \mathcal{H}_+} V_{p,r}^0(\lambda, \mu)$$

is valid. If the dual of Problem ($P_{p,r}^0$) is solvable, then the limit relation $(\lambda_{p,r}^{\delta,\alpha(\delta)}, \mu_{p,r}^{\delta,\alpha(\delta)}) \to (\lambda_{p,r}^0, \mu_{p,r}^0)$, $\delta \to 0$ is valid also, where $(\lambda_{p,r}^0, \mu_{p,r}^0)$ denotes minimum-norm solution of the dual problem.
This theorem may be proved in exact accordance with a scheme of proving the
similar theorem in [11]. We note only that, as in [11], this proving uses a weak
continuity of the operators $g_1^\delta, g_2^\delta$ that is consequence of the conditions on the
input data of Problem ($P_{p,r}^0$) and a regularity of the bounded solutions of the
boundary-value problem (1) inside of the cylinder $Q_T$ [8, ch.III, theorem 10.1].

## 3.2 Stable Sequential Lagrange Principle for Optimal Control Problem with Pointwise State Constraints

We formulate in this subsection the necessary and sufficient condition for existence of a minimizing approximate solution in Problem ($P_{p,r}^0$). Also, it can be called by stable sequential Lagrange principle in nondifferential form for this problem. Simultaneously, as we deal only with regular Lagrange function, the formulated theorem may be called by Kuhn-Tucker theorem in nondifferential form. Note that the necessity of the conditions of formulated below theorem follows from the theorem 1. At the same time, their sufficiency is a simple consequence of the convexity of Problem ($P_{p,r}^0$) and the conditions on its input data. A verification of these propositions for similar situation of the convex programming problem in a Hilbert space may be found in [1, 7].

**Theorem 2.** Regardless of the properties of the subdifferential $\partial\beta(p,r)$ (it is empty or not empty) or, in other words, regardless of the properties of the solvability of the dual problem to Problem ($P_{p,r}^0$), necessary and sufficient conditions for Problem ($P_{p,r}^0$) to have a minimizing approximate solution is that there is a sequence of dual variables $(\lambda^k, \mu^k) \in \mathcal{H} \times \mathcal{H}_+$, $k = 1, 2, \dots$, such that $\delta^k \|(\lambda^k, \mu^k)\| \to 0$, $k \to \infty$, and relations

$$ \pi^{\delta^k}[\lambda^k, \mu^k] \in \mathcal{D}_{p,r}^{\delta^k, \epsilon^k}, \quad \epsilon^k \to 0, \quad k \to \infty, \qquad (6) $$

$$ \langle (\lambda^k, \mu^k), (g_1^{\delta^k}(\pi^{\delta^k}[\lambda^k, \mu^k]) - h^{\delta^k} - p, g_2^{\delta^k}(\pi^{\delta^k}[\lambda^k, \mu^k]) - r) \rangle \to 0, \quad k \to \infty \quad (7) $$

hold for some elements $\pi^{\delta^k}[\lambda^k, \mu^k] \in U^{\delta^k}[\lambda^k, \mu^k]$. The sequence $\pi^{\delta^k}[\lambda^k, \mu^k]$, $k = 1, 2, \dots$, is the desired minimizing approximate solution and each of its weak limit points is a solution of Problem ($P_{p,r}^0$). As $(\lambda^k, \mu^k) \in \mathcal{H} \times \mathcal{H}_+$, $k = 1, 2, \dots$, we can use the sequence of the points $(\lambda_{p,r}^{\delta^k, \alpha(\delta^k)}, \mu_{p,r}^{\delta^k, \alpha(\delta^k)})$, $k = 1, 2, \dots$, generated by the dual regularization method of the theorem 1. If the dual of Problem ($P_{p,r}^0$) is solvable, the sequence $(\lambda^k, \mu^k) \in \mathcal{H} \times \mathcal{H}_+$, $k = 1, 2, \dots$, should be assumed to be bounded. The limit relation

$$ V_{p,r}^{0}(\lambda^{k}, \mu^{k}) \rightarrow \sup_{(\lambda, \mu) \in \mathcal{H} \times \mathcal{H}_{+}} V_{p,r}^{0}(\lambda, \mu) \qquad (8) $$

holds as a consequence of the relations (6), (7). Furthermore, each weak limit
point (if such points exist) of the sequence $(\lambda^k, \mu^k) \in \mathcal{H} \times \mathcal{H}_+$, $k = 1, 2, \dots$ is a
solution of the dual problem $V_{p,r}^0(\lambda, \mu) \to \max$, $(\lambda, \mu) \in \mathcal{H} \times \mathcal{H}_+$.
Remark 2. If the functional $g_0^0$ is strongly convex and subdifferentiable on $\mathcal{D}$ then from the weak convergence of the unique in this case elements $\pi^{\delta^k}[\lambda^k, \mu^k]$ to unique element $\pi_{p,r}^0$ as $k \to \infty$, and numerical convergence $g_0^0(\pi^{\delta^k}[\lambda^k, \mu^k]) \to g_0^0(\pi_{p,r}^0)$, $k \to \infty$ follows the strong convergence $\pi^{\delta^k}[\lambda^k, \mu^k] \to \pi_{p,r}^0$, $k \to \infty$. Problem $(P_{p,r}^0)$ with the strongly convex $g_0^0$ for linear system of ordinary differential equations but with exact input data is studied in [10].

### 3.3 Stable Sequential Pontryagin Maximum Principle for Optimal Control Problem with Pointwise State Constraints

Denote by $U_{max}^{\delta}[\lambda, \mu]$ a set of the elements $\pi \in \mathcal{D}$ that satisfy all relations of the maximum principle (4) of the lemma 1. Under the supplementary condition of existence of continuous with respect to $z$ gradients $\nabla_z\varphi_2^{\delta}(x, t, z)$, $\nabla_z G^{\delta}(x, z)$ with corresponding estimates, it follows that the proposition of the theorem 2 may be rewritten in the form of the stable sequential Pontryagin maximum principle. It is obviously that the equality $U_{max}^{\delta}[\lambda, \mu] = U^{\delta}[\lambda, \mu]$ takes place under mentioned supplementary condition.

**Theorem 3.** Regardless of the properties of the subdifferential $\partial\beta(p,r)$ (it is empty or not empty) or, in other words, regardless of the properties of the solvability of the dual problem to Problem $(P_{p,r}^0)$, necessary and sufficient conditions for Problem $(P_{p,r}^0)$ to have a minimizing approximate solution is that there is a sequence of dual variables $(\lambda^k, \mu^k) \in \mathcal{H} \times \mathcal{H}_+$, $k = 1, 2, \dots$, such that $\delta^k \|(\lambda^k, \mu^k)\| \to 0$, $k \to \infty$, and relations (6), (7) hold for some elements $\pi^{\delta^k}[\lambda^k, \mu^k] \in U_{max}^{\delta^k}[\lambda^k, \mu^k]$. Moreover, the sequence $\pi^{\delta^k}[\lambda^k, \mu^k]$, $k = 1, 2, \dots$, is the desired minimizing approximate solution and each of its weak limit points is a solution of Problem $(P_{p,r}^0)$. As $(\lambda^k, \mu^k) \in \mathcal{H} \times \mathcal{H}_+$, $k = 1, 2, \dots$, we can use the sequence of the points $(\lambda_{p,r}^{\delta^k, \alpha(\delta^k)}, \mu_{p,r}^{\delta^k, \alpha(\delta^k)})$, $k = 1, 2, \dots$, generated by the dual regularization method of the theorem 1. If the dual of Problem $(P_{p,r}^0)$ is solvable, the sequence $(\lambda^k, \mu^k) \in \mathcal{H} \times \mathcal{H}_+$, $k = 1, 2, \dots$, should be assumed to be bounded. The limit relation (8) holds as a consequence of the relations (6), (7).

**Remark 3.** When the inequality constraint in Problem $(P_{p,r}^0)$ is absent, i.e., $(P_{p,r}^0) = (P_p^0)$, and $\varphi_2(x,t) = r \equiv 0$, $\varphi_1(x,t) \equiv 1$, the target functional $g_0^0$ is taken, for example, in the form $g_0^0(\pi) \equiv \|\pi\|^2 \equiv \|u\|^2 + \|w\|^2$ then Problem $(P_p^0)$ acquires the typical form of unstable inverse problem. In this case the stable sequential Pontryagin maximum principle of the theorem 3 becomes a tool for the direct solving such unstable inverse problem.

**Remark 4.** In important partial case of Problem $(P_{p,r}^0) = (P_r^0)$, when it has only the inequality constraint $(\varphi_1^\delta(x,t) = h^\delta(x,t) = p(x,t) = 0$, $(x,t) \in Q)$, “weak” passage to the limit in the relations of the theorem 3 leads to usual for similar optimal control problems Pontryagin maximum principle (see, e.g., [9, 16]) with nonnegative Radon measures in the input data of the adjoint equation.
**Acknowledgments.** This work was supported by the Russian Foundation for Basic Research (project no. 15-47-02294-r_povolzh'e_a) and by the Ministry of Education and Science of the Russian Federation within the framework of project part of state tasks in 2014-2016 (code no. 1727).

**References**

1. Sumin, M.I.: Stable Sequential Convex Programming in a Hilbert Space and its Application for Solving Unstable Problems. Comput. Math. Math. Phys. 54, 22–44 (2014)

2. Sumin, M.I.: A Regularized Gradient Dual Method for the Inverse Problem of a Final Observation for a Parabolic Equation. Comput. Math. Math. Phys. 44, 1903–1921 (2004)

3. Sumin, M.I.: Duality-Based Regularization in a Linear Convex Mathematical Programming Problem. Comput. Math. Math. Phys. 46, 579–600 (2007)

4. Sumin, M.I.: Regularized Parametric Kuhn-Tucker Theorem in a Hilbert Space. Comput. Math. Math. Phys. 51, 1489–1509 (2011)

5. Warga, J.: Optimal Control of Differential and Functional Equations. Academic, New York (1972)

6. Sumin, M.I.: Dual Regularization and Pontryagin's Maximum Principle in a Problem of Optimal Boundary Control for a Parabolic Equation with Nondifferentiable Functionals. Proc. of the Steklov Inst. of Math. 275 (Suppl), S161-S177 (2011)

7. Sumin, M.I.: On the Stable Sequential Kuhn-Tucker Theorem and its Applications. Appl. Math. 3, 1334–1350 (2012)

8. Ladyzhenskaya, O.A., Solonnikov, V.A., Ural'tseva, N.N.: Linear and Quasilinear Equations of Parabolic Type. Am. Math. Soc., Providence, R.I. (1968)

9. Casas, E., Raymond, J.-P., Zidani, H.: Pontryagin's Principle for Local Solutions of Control Problems with Mixed Control-State Constraints. SIAM J. Control Optim. 39, 1182–1203 (2000)

10. Sumin, M.I.: Parametric Dual Regularization for an Optimal Control Problem with Pointwise State Constraints. Comput. Math. Math. Phys. 49, 1987–2005 (2009)

11. Sumin, M.I.: Stable Sequential Pontryagin Maximum Principle in Optimal Control Problem with State Constraints. In: Proceedings of XIIth All-Russia Conference on Control Problems, pp. 796–808. Inst. of Control Sci. of RAS, Moscow (2014)

12. Plotnikov, V.I.: Existence and Uniqueness Theorems and a Priori Properties of Weak Solutions. Dokl. Akad. Nauk SSSR. 165, 33–35 (1965)

13. Sumin, M.I.: The First Variation and Pontryagin's Maximum Principle in Optimal Control for Partial Differential Equations. Comput. Math. Math. Phys. 49, 958–978 (2009)

14. Sumin, M.I.: Stable Sequential Pontryagin Maximum Principle in Optimal Control for Distributed Systems. In: International Conference "Systems Dynamics and Control Processes" dedicated to the 90-th Anniversary of Academician N.N. Krasovskii (Ekaterinburg, Russia, Sept. 15-20, 2014), pp. 301–308. Ural Federal University, Ekaterinburg (2015)

15. Sumin, M.I.: Subdifferentiability of Value Functions and Regularization of Pontryagin Maximum Principle in Optimal Control for Distributed Systems. Tambov State University Reports. Series: Natural and Tech. Sci. 20, 1461–1477 (2015)

16. Raymond, J.-P., Zidani, H.: Pontryagin's Principle for State-Constrained Control Problems Governed by Parabolic Equations with Unbounded Controls. SIAM J. Control Optim. 36. 1853–1879 (1998)