# Robust Model Predictive Control Schemes for Tracking Setpoints

Authors: Vu Trieu Minh; Fakhruldin Bin Mohd Hashim
Journal: Journal of Control Science and Engineering
 (2010)

---

## Abstract

This paper briefly reviews the development of nontracking robust model predictive control (RMPC) schemes for uncertain systems using linear matrix inequalities (LMIs) subject to input saturated and softened state constraints. Then we develop two new tracking setpoint RMPC schemes with common Lyapunov function and with zero terminal equality subject to input saturated and softened state constraints. The novel tracking setpoint RMPC schemes are able to stabilize uncertain systems once the output setpoints lead to the violation of the state constraints. The state violation can be regulated by changing the value of the weighting factor. A brief comparative simulation study of the two tracking setpoint RMPC schemes is done via simple examples to demonstrate the ability of the softened state constraint schemes. Finally, some features of future research from this study are discussed.


---

## Body

## 1. Introduction

Model predictive control (MPC) refers to a class of algorithms that compute a sequence of manipulated variable adjustments in order to optimize the future behavior of a plant. MPC works out the optimal open-loop-manipulated input trajectory that minimizes the difference between the predicted plant behavior and the desired plant behavior. It differs from other control theories in that the optimal control problem is solved on-line for the current state of the plant, rather than determined off-line as a feedback policy. MPC has been widely applied in the petrochemical and related industries because of its ability to handle input and output constraints in the optimal control problem. However MPC is not designed to explicitly handle plant-model uncertainty and such system might perform very poorly when implemented on a physical system which is not exactly described by the model [1].Robust model predictive control (RMPC) is a class of predictive control schemes that counts for the modeling error in the controller design. Instead of forecasting the system behavior by using one process model as in MPC, RMPC forecasts the system behavior for all possible models in the uncertainty set. The optimal actions are determined through the min-max optimization, which minimizes the deviation of the forecasted behavior from the desired behavior for the model with the largest deviation.Modeling the uncertainty has been studied by a number of researchers. The two common types of uncertainties are parametric uncertainty and bounded disturbance regions. Magni et al. [2] and Rami and Zhou [3] proposed using multiplicative input and state uncertainties. Parametric uncertainties are modeled as either bounded uncertainty regions or a polytopic set.Researchers have proved robust stability for MPC by using the closed loop stability criteria, that is, terminal cost and terminal stability constraints. The simplest way to enforce stability with a finite prediction horizon is to add a so-called zero-terminal equality at the end of the prediction horizon in Keerthi and Gilbert [4]. One disadvantage of a zero terminal equality is that the system must be brought into the origin in a finite time. This leads, in general, to infeasibility for the short control horizon length; that is, the horizon length may not be long enough to satisfy the constraints from all states.Mayne and Michalska [5] developed a concept of terminal region with the dual mode approach. The terminal region concept can be viewed as a relaxation of the zero terminal equality. Several other schemes have been proposed by Rawlings [6], Morari and Lee [7], Allgower et al. [8], and Chen and Allgower [9], that try to overcome the use of zero terminal equality. Most of them use the terminal region constraint and/or terminal penalty with an assumption that there exists a neighborhood of the origin for which the linear feedback control law is asymptotically stabilizing. This neighborhood serves as the terminal region for the finite horizon controller. Minh and Afzulpurkar [10] developed a MPC scheme without a terminal region using the softened state constraints.The regulator determines the optimal manipulated input trajectory based on the system behavior predictions of the models. Scokaert and Mayne [11] proposed a min-max control law that steered the state into an invariant region in which the state feedback law guaranteed convergence to the origin for all states. The main disadvantage of min-max control theories is the computational complexity. These optimization problems are expensive to solve on-line.Recent developments in the theory and application of the optimization involving linear matrix inequalities (LMIs) to MPC have resulted in a new class of methodologies for MPC because it is now possible to recast much of existing robust control theory in the framework of LMIs and because optimization problems can now be solved and implemented on-line (Henrion et al. [12] and Primbs [13]).Kothare et al. [14] proposed using an LMI-based optimizer to find robustly stabilizing state feedback gains that minimizes the worst performance objective for a given model uncertainty description. Casavola et al. [15] developed the concept to uncertain systems with input-saturated constraints.The processes might have both input and state constraints; so a difficulty will arise due to the inability to satisfy the state constraints. Since the RMPC regulator is designed for online implementation, any infeasible solution of the optimization problems cannot be tolerated. To guarantee the system stability once the state space violates the constraints, Minh and Afzulpurkar [16] have developed an RMPC algorithm for input-saturated and softened state constraints using penalty terms added into the objective function. These terms keep the state violation at low values until a constrained solution is returned. The state violation can be regulated by changing the value of the weighting factor.The RMPC algorithm in Minh and Afzulpurkar [16] was restricted to the finite horizon regulator with a zero target or nontracking setpoint. In this paper, we extend the RMPC algorithm in [16] for tracking setpoint RMPC algorithm. The new RMPC algorithm allows the system to track a reference output trajectory different from the origin.Our paper is organized as follows. Section2 gives a description of the uncertain system used by the authors. Section 3 summarizes the nontracking RMPC scheme for input-saturated and softened state constrains. Section 4 develops a tracking setpoint RMPC scheme using a common Lyapunov function. Section 5 develops a tracking setpoint RMPC scheme using a zero terminal equality. And finally, in Section 6, conclusions and some features of future research are discussed.


## 2. Description of Uncertain System

For modeling uncertain system, instead of relying on the parameterization of the process, our uncertain system is described by the following discrete state-space model similar to the multiple models described by Kothare et al. [14]:(1)x(k+1)=A(k)x(k)+B(k)u(k),y(k)=Cx(k),[A(k)B(k)]∈Ω,
in which A(k)B(k) are the time-varying state-space model matrices; C∈ℝp,n describes the relationship between the output and the state without any uncertainty; x(k)∈ℝn, u(k)∈ℝm, and y(k)∈ℝp are the state, input and output vectors, respectively. When model uncertainty is present, the exact plant model [A(k)B(k)] is unknown, the model uncertainty belongs to a polytopic set Ω=Co{[A1B1],[A2B2],…,[ALBL]}, where Co refers to a convex hull or [A(k)B(k)]∈Ω=∑j=1Lαj(k)[AjBj], where  αj(k)≥0 and ∑j=1Lαj(k)=1.In RMPC, the regulator determines the optimal manipulated input trajectory based on the system behavior predictions of the models. We use a scheme similar to the method introduced by Scokaert and Mayne [11] that produces a tree trajectory for all possible time-varying combinations of the models. Figure 1 illustrates all possible state trajectories of all models with L=2 over the prediction horizon length NY=3. Xk+ih and Uk+ih denote the possible predicted state and input vectors h at time k+i, for i=0,1,…,NY.Figure 1
Tree trajectory withL=2 and N=3 in the x∈ℝ2 state space.The total number of nodesη depends on the total number of possible state trajectories of all models L and the prediction horizon length:
(2)NY:η={NY+1ifL=1,LNY+1-1L-1ifL>1.The total number of branchesβ is dependent on the number of models L and the prediction horizon length NY: β=LNY.The objective of the control problem is to find the control actions that, once implemented, cause all branches in the tree trajectory to converge to a robust control invariant set in which a state feedback law guarantees convergence to the origin for all states.


## 3. Summary of Nontracking RMPC Scheme for Input-Saturated and Softened State Constraints

In the infinite horizon RMPC, Kothare et al. [14] proposed an RMPC scheme using LMIs that minimizes a robust performance objective function in quadratic form at each sampling time k:(3)minu(k+i)(max[AjBj]∈ΩJ∞(k)),
where J∞(k)=∑i=0∞{x(k+i∣k)′Qx(k+i∣k)+u(k+i∣k)'Ru(k+i∣k)}, where Q>0 and R>0 are symmetric weighting matrices; J∞(k) is referred to as the infinite horizon RMPC. The minimization is performed with a constant feedback control law u(k+i∣k)=K(k)x(k+i∣k).This is a min-max problem. The maximization over the setΩ and corresponding to choosing that time varying model [AjBj]∈Ω would lead to the largest or “worst-case” value of J∞(k) among all models in Ω. Suppose that there exists a Lyapunov function Φ with Φ(0)=0 and Φ(x(k))=x(k)′PLx(k)≥J∞(k) with PL>0. For the objective function to be finite, x(∞∣k)=0 and, hence, Φ(x(∞∣k))=0, the system will be stable if the Lyapunov function is decreasing, that is, Φ(x(k+1))-Φ(x(k))≤0. Thus, Φ(x(k+i+1∣k))-Φ(x(k+i∣k))≤-x(k+i∣k)′Qx(k+i∣k)-u(k+i∣k)′Ru(k+i∣k) for all k,i=0,1,…,∞, or an upper bound of max[AjBj]∈ΩJ∞(k)≤Φ(x(k∣k)). Substituting uj(k+i∣k)=K(k)xj(k+i∣k) and xj(k+1)=Ajxj(k)+Bjuj(k) with j={1,2,…,L}, then we have PL-(Aj+BjK)′PL(Aj+BjK)-Q-K′RK≥0. Set K=YP-1 and PL=γP-1 (P>0 and scalar γ>0); the above equation can be transformed as(4)P-(AjP+BjY)′P-1(AjP+BjY)-(Q1/2P)′γ-1(Q1/2P)-(R12Y)γ-1(R12Y)≥0.
Equation (4) is equal to an LMI (using Schur complement) of(5)[PPAj′+Y′Bj′PQ1/2Y′R1/2AjP+BjYP00Q1/2P0γI0R1/2Y00γI]≥0forj={1,2,…,L}.
For the unconstrained infinite horizon RMPC, we can find a state feedback gain K=YP-1 in the control law for all model uncertainties uj(k)=Kxj(k) and xj(k+1)=Ajxj(k)+Bjuj(k) for j={1,2,…,L}, which guarantees decreasing robust performance since we have found out a common Lyapunov matrix P=γPL-1 for all models in (5).Then, the infinite horizon RMPC scheme for thehard input-saturated and output-saturated constraints can be set up as follows (6)–(10):
(6)minP>0,Y,γ>0γ
subject to(7)[1x(k∣k)′x(k∣k)P]≥0,(8)[PPAj′+Y′Bj′PQ1/2Y′R1/2AjP+BjYP00Q1/2P0γI0R1/2Y00γI]≥0,j={1,2,…,L},(9)[uii2IY′YP]≥0,uii≤uii_max
with uii denoting the iith entry of the unit matrix I for input constraints, and/or(10)[yii2I(AjP+BjY)′C′C(AjP+BjY)P]≥0,j={1,2,…,L},yii≤yii_max
with yiidenoting the iith entry of the unit matrix I for output constraints.At each time instant and based on the current statex(k), this algorithm generates a feasible state feedback K(k)=Y(k)P-1(k). We then immediately calculate the control input u(k)=K(k)x(k). There is no free moving horizon prediction; thus, this algorithm can be considered as an RMPC scheme with a prediction horizon length NY=0. The stability of the uncertain systems in (1) is guaranteed if we can always find a common Lyapunov matrix P=γPL-1 for all models in (8).When bothhard input and output/state constraints are imposed, difficulty will arise from the inability of the optimizer to satisfy the state/output constraints due to the constraints on the input. Based on the above infinite horizon RMPC scheme, Casavola et al. [15] formulated a finite horizon RMPC scheme for the input-saturated constraints. Then, Minh and Afzulpurkar [16] developed a finite horizon RMPC scheme for the input-saturated and the softened state constraints. The idea to develop an RMPC scheme with the softened state constraints comes from the reality that RMPC regulator is designed for an online implementation; any infeasible solution of the optimization problem cannot be tolerated. Input constraints are based on the physical limits and can be considered as hard constraints. If the state constraints are not strictly imposed and can be violated somewhat during the evolution of the system, they can be considered as the softened constraints. The finite horizon RMPC control sequence with NU free control moves is presented as follows:(11)u(·∣k)={K(k)x(k+i∣k)+c(k)fori=0,1,…,NU-1K(k)x(k+i∣k)fori≥NU,
where K(k) is a feasible and robustly stabilizing state-feedback and c(k) is free control moves selected on-line by the MPC solver corresponding to NU initial free control moves as referred to in [17, 18]. For simplicity, from the following sections, the authors assume that the prediction horizon length is set equal to the control horizon length, that is, NY=NU=N.  The stability of the system is enforced after N free moves with the constraint of input u(k+i∣k)=K(k)x(k+i∣k) for i≥N. It is assumed that the state feedback gain K(k) and a common Lyapunov matrix PL(k) and variable γ(k) are existed and jointly satisfied the LMIs of infinite horizon RMPC scheme at x=x(k). Then PL=γP-1, K(k), and free moves of input u*(k+i∣k) for i=0,1,…,N-1 are selected by minimizing the following objective function:(12)min(PL(k),K(k),u*(·∣k))JF(k)=maxz∈vert{χu*(·∣k)k+N∣k(x(k))}z′PL(k)z+∑i=0N-1{maxz(i)∈vert{χu*(·k)k+i∣k(x(k))}z(i)′Qz(i)+u*(k+i∣k)′Ru*(k+i∣k)maxz(i)∈vert{cu*(.k)k+i∣k(x(k))}},
where Q>0 and R>0are symmetric weighting matrices; JF(k) is referred to as the finite horizon RMPC subject to the constraints that u*(k+i∣k)∈Ωu∈ℝm, for all i∈{0,1,…,N-1}, and vert{χu*(·∣k)k+N∣k(x(k))}⊂ζ(PL(k),γ(k)) where vert{·} denotes the vertices and ζ(·) is the ellipsoidal set ζ(PL(k),γ(k))={x(k)∈ℝn:x(k)′PL(k)x(k)≤γ(k)}. The set χu*(·∣k)k+i∣k(x(k)) denotes the convex hull of all i-step ahead state predictions from x(k) at time k through application of the input sequence {u*(k+i∣k)}i=0N-1.  The robustness of MPC can increase if we can relax some state constraints to softened constraints with penalty terms added into the objective function (12); these terms keep the state violation at low values until a constrained solution is returned:(13)min(PL(k),K(k),u*(·∣k))JN(k)=JF+∑i=0N-1εi,u*(k+i∣k)∈ℝm
subject to (14)[xii2I+μεiIz′zI]≥0,{∀i∈{0,1,…,N-1},∀z(i)∈vert{χu*(·∣k)k+i∣k(x(k))},u*(k+i∣k)∈ℝm,xii≤xii_max,
where μ is the weighting factor for the softened state constraints (μ>0, usually a small value) and εi represents the state penalty terms εi≥0 added to the RMPC objective function. εi depends on the current state x(k), application of the input sequence {u*(k+i∣k)}i=0N-1, and the weighting factor μ. When the state constraints are satisfied, the RMPC algorithm in (14) will set all softened state penalty terms εi=0.In the next parts, we will develop novel tracking setpoint RMPC schemes using LMIs subject to input-saturated and softened state constraints.


## 4. Tracking Setpoint RMPC Scheme with Common Lyapunov Function

In reality, the system output is usually required to track a reference trajectory. In some operations the desired values might change overtime. Suppose that the system outputy(k) is required to track a target vector r(k) (called the setpoint) and the desired equilibrium state and input are constant points xr(k) and ur(k), different from the origin. For the uncertain system in (1), we assume that [A(k)B(k)]∈Ω are constant unknown matrices and xr(k) and ur(k) are feasible; that is, they satisfy the imposed constraints and xr(k+1)=Axr(k)+Bur(k), and r(k)=Cxr(k). The objective function for the infinite horizon RMPC with the tracking setpoint is as follows: (15)J∞(k)=∑i=0∞{[C(x(k+1∣k)-xr(k))]′Q1[C(x(k+1∣k)-xr(k))]+[u(k+1∣k)-ur(k)]′R1[u(k+1∣k)-ur(k)]},
where Q1>0 and R1>0 are symmetric weighting matrices. We can define a shifted state x̃(k)=x(k)-xr(k), a shifted input ũ(k)=u(k)-ur(k), and a new weighting matrix QC=C′Q1C to reduce the problem in (15) to standard form:(16)J∞(k)=∑i=0∞{x̃(k+i∣k)′QCx̃(k+i∣k)+ũ(k+i∣k)′R1ũ(k+i∣k)}.
The infinite horizon RMPC for tracking setpoint in (16) becomes similar to the nontracking infinite horizon RMPC in (3). Then, the finite horizon RMPC control sequence for tracking setpoint with N free control moves is developed for the shifted state and input:(17)ũ(·∣k)={K(k)x̃(k+i∣k)+c(k)fori=0,1,…,N-1,K(k)x̃(k+i∣k)fori≥N.
And the objective function of the finite horizon RMPC for tracking setpoint is as follows:(18)min(PL(k),K(k),ũ*(·∣k))JÑ(k)=maxz̃∈vert{χũ*(·∣k)k+N∣k(x̃(k))}z̃′PL(k)z̃+∑i=0N-1{maxz̃(i)∈vert{χũ*(·k)k+i∣k(x̃(k))}z̃(i)′QCz̃(i)+ũ*(k+i∣k)′R1ũ*(k+i∣k)maxz̃(i)∈vert{cũ*(.k)k+i∣k(x̃(k))}},
where JÑ(k)  is referred to as the tracking setpoint RMPC subject to the shifted input and state constraints that ũ*(k+i∣k)∈ℝm and vert{χũ*(·∣k)k+N∣k(x̃(k))}∈ℝn, for all i∈{0,1,…,N}.The saturated input and state constraints for the new shifted input and state are as follows:(19)|u(k)|≤|umax|⇔|ũ(k)+ur|≤|umax|⇔-umax-ur≤ũ(k)≤umax-ur,(20)|x(k)|≤|xmax|⇔|x̃(k)+xr|≤|xmax|⇔-xmax-xr≤x̃(k)≤xmax-xr.
In the tracking setpoint RMPC scheme, the saturated input and state constraints should be imposed in shifted forms as in (19) and (20). A finite tracking setpoint RMPC scheme with a common Lyapunov function to select ũ*(k+i∣k) subject to the shifted input and softened state constraints is developed as follows.(i) Initialization
Givenx(0) = -xr(0), find [γ(0),P(0),Y(0),ũ0(·∣0)] = argminγ>0,εi>0,Y,P>0,u*(·∣0)γ + ∑i=1ηεi,  where ∑i=1ηεi are the penalty terms for the softened state constraints in all possible nodes η added to the objective function, subject to(0.i)
(21)[PPAj′+Y′Bj′PQC1/2Y′R11/2AjP+BjYP00QC1/2P0γI0R11/2Y00γI]≥0forj={1,2,…,L},(0.ii)
(22)[xii2I+μεiIz̃′z̃I]≥0,{∀i∈{0,1,…,N-1},∀z̃(i)∈vert{χũ*(·∣0)k+i∣0(x̃(k))},xii≤xii_max
subject to the shifted state constraints in (20), and μ is the weighting factor for the softened state constraints.(0.iii)
(23)[1z̃'z̃P]≥0,∀z̃∈vert{χũ*(·∣0)k+N∣0(x̃(0))},(0.iii)
[uii2Iũ*(i∣0)′ũ*(i∣0)I]≥0 for i=0,1,…,N-1, uii≤uii_max subject to the shifted input constraints in (19).(ii) Operation
Step 1.
For anyk≥0, given x̃(k), P(k), and γ(k), find [ũ0(·∣k)]=argminJj>0,Ji>0,εi>0,ũ*(·∣k)∑j=1βJj+∑i=1ηJi+∑i=1ηεi where β and η are all possible nodes and branches, subject to(i)
(24)[Jjz̃'z̃γ-1(k)P(k)]≥0,∀z̃∈vert{χũ*(·∣k)k+N∣k(x̃(k))},(ii)
(25)[Iz̃(i)′QC1/2ũ*(k+i∣k)′R11/2QC1/2z̃(i)JiI0R11/2ũ*(k+i∣k)0JiI]≥0,{∀i∈{0,1,…,N-1},∀z̃(i)∈vert{χũ*(·∣k)k+i∣k(x̃(k))},(iii)
(26)[xmax2I+μεiIz̃′z̃I]≥0,{∀i∈{0,1,…,N-1},∀z̃(i)∈vert{χũ*(·∣k)k+i∣k(x̃(k))}
subject to the shifted state constraints in (20), and μ is the weighting factor for the softened state constraints,(iv)
[uii2Iũ*(i∣k)′ũ*(i∣k)I]≥0, for i=0,1,…,N-1, uii≤uii_max subject to the shifted input constraints in (19).Step 2.
Feed the plant by the inputũ(k)=ũ0(k∣k).Step 3.
For anyk≥0, given x̃(k), K(k), and ũ0(·∣k), find again an update common Lyapunov matrix P(k+1) and a feasible state feedback gain K(k+1)=Y(k+1)P-1(k+1) by finding [P(k+1),Y(k+1),γ(k+1)]=argminP>0,Y,γ>0γ,  subject to(v)
(27)[PPAj′+Y′Bj′PQC1/2Y′R11/2AjP+BjYP00QC1/2P0γI0R11/2Y00γI]≥0forj={1,2,…,L},(vi)
(28)[Iz̃'z̃P]≥0,∀z̃∈vert{χũ*(·∣k)k+N∣k(x̃(k))},(vii)
(29)[uii2IY′YP]≥0,uii≤uii_max,(viii)
(30)[Iz̃′(Aj+BjK(k))′(Aj+BjK(k))z̃P]≥0,{∀z̃∈vert{χũ*(·∣k)k+N∣k(x̃(k))},∀j∈{1,2,…,L},Step 4.
x(k)=x̃(k)+xr(k), u(k)=ũ(k)+ur(k), k←k+1 and go to Step 1.We illustrate this tracking setpoint RMPC scheme with the following example.Example 1.
We consider the following set of uncertain models(31)Ω={(A1,B1),(A2,B2)},
with model 1:
(32)x(k+1)=[0.90-0.800.300.80]x(k)+[0.200.20]u(k),
and model 2:
(33)x(k+1)=[0.85-0.750.350.75]x(k)+[0.100.10]u(k),
and the system output: y(k)=[0.50.5]x(k).A simulation is conducted with the system outputy(k) to track a reference setpoint at r(k)=0.2. The real model [A(k)B(k)]=∑i=1L=2αi(k)[AiBi] has α1=α2=0.5, and the weighting matrices are set  Q1=[1] and R1=[1]. The shifted input and state are calculated as  ur=-7.4667 and xr=[2.2-1.8]. Now it is assumed to impose a hard constraint on the input |u(k)|≤|umax|=8 and a softened constraint on the state |x(k)|≤|x1maxx2max|=[2.32]. Then, the new shifted input and state constraints for this tracking setpoint RMPC are [0.5333]≤ũ(k)≤[15.4667] and  [-4.5-0.2]≤x̃(k)≤[0.13.8].Figure2 shows the input and the output of the tracking setpoint RMPC performance with receding horizons N=1 and N=2 and a weighting factor for the softened state constraint μ=1. The hard constraint on input |u(k)|≤|umax|=8 or u(k)min≥-8,  near the equilibrium position of input ur=-7.4667, causes oscillations on the output. Results similar to those by Minh and Afzulpurkar [16] are obtained; a significant reduction in conservativeness is achieved by simply letting one free move be added as the input commands are closer to the constraint boundary (-8). Therefore, the RMPC output with a longer receding horizon N=2 approaches its setpoint faster than that with a shorter receding horizon N=1.Tracking RMPC withN=1 and N=2.
(a)(b)Figure3 compares the output speeds to approach the setpoint reference with different weighting values μ. Due to the decreasing of the weighting values μ, the values of the state penalty terms εi will increase and keep the state violations at lower values. Then, the RMPC with smaller value of μ approaches the setpoint reference faster than the RMPC with greater value of μ. Softened state penalty terms help RMPC to find a solution when the state values are violated constraints, and when the state constraints are satisfied, the RMPC will set all state penalty terms to zero.Figure 3
Outputs of Tracking RMPC with different weighting valuesμ.Figure4 shows the results of controlling the state violation by changing the value of μ. For the values μ=1, 1/10, and 1/100, we obtained the maximum values of x1=3.2693, 2.6874, and 2.3752, respectively. By decreasing the weighting values μ, we could significantly reduce the state constraint violations x1max≤2.3. However, when we further decrease the values of μ, as shown by this example with μ<1/100, we cannot further reduce the state constraint violations since we have reached a control “limit”. If we set a very small weighting value μ=1/10000, the maximum value of x1 is still unchanged at 2.3675.States of Tracking RMPC with different weighting valuesμ.
(a)(b)


## 5. Setpoint Tracking RMPC Scheme with Zero Terminal Equality

A similar result in [19] can be applied for the above tracking setpoint RMPC scheme with a common Lyapunov matrix to find a robust stabilizing state feedback for the uncertain systems. However we still have other methods to ensure the stability within a finite prediction horizon. It is to use a terminal region constraint at the end of the prediction horizon.We consider the objective function of the RMPC in (18); the simplest possibility to enforce the stability with a finite prediction horizon is to add a so-called zero-terminal equality at the end of the prediction horizon, that is, to add a zero constraint for the terminal prediction state: x̃(k+N∣k)=0 or z̃∈vert{χũ*(·∣k)k+N∣k(x̃(k))}=0 or z̃'PL(k)z̃=0. The state-feedback gain K(k) used to define the input sequence after the first N free moves ũ*(k+N∣k)=K(k)x̃(k+N∣k) is also set to zero, ũ*(k+N∣k)=0. The objective function in (18) can be rewritten as(34)min(ũ*(·∣k))JÑ(k)=∑i=0N-1{maxz̃(i)∈vert{χũ*(·∣k)k+i∣k(x̃(k))}z̃(i)′QCz̃(i)+ũ*(k+i∣k)′R1ũ*(k+i∣k)maxz̃(i)∈vert{cũ*(·k)k+i∣k(x̃(k))}}.Equation (34) is equivalent to the following LMI (using the Schur complement):(35)[Iz̃(i)′QC1/2ũ*(k+i∣k)′R11/2QC1/2z̃(i)JiI0R11/2ũ*(k+i∣k)0JiI]≥0,{∀i∈{0,1,…,N-1},∀z̃(i)∈vert{χũ*(·∣k)k+i∣k(x̃(k))}.
To prove the stability of the system, we denote ũk*≜(ũ*(k),ũ*(k+1),…,ũ*(k+N-1)), and ũk+1*≜(ũ*(k+1),ũ*(k+2),…,ũ*(k+N))=(ũ*(k+1),ũ*(k+2),…,0), the Lyapunov function Φ(k)=J(k,ũk*,x̃(k)), and Φ(k+1)=J(k+1,ũk+1*,x̃(k+1))=Φ(k)-x̃(k)′Qx̃(k)-ũ*(k)′Rũ*(k). Then,(36)Φ(k+1)-Φ(k)=-x̃(k)′Qx̃(k)-ũ*(k)′Rũ*(k)≤0.
Since the Lyapunov function Φ(k) is decreasing, the system with a zero terminal equality becomes always stable.Another tracking setpoint RMPC scheme to selectũ*(k+i∣k) subject to a zero terminal equality is developed as follows.Step 1.
Fork≥0, given x̃(0)=-xr(0), find[ũ0(·∣k)]=argminJi>0,εi>0,ũ*(·∣k)∑i=1ηJi+∑i=1ηεi where η are all possible nodes of the uncertain system, subject to(i)
(37)[0z̃'z̃I]≥0,∀z̃∈vert{χũ*(·∣k)k+N∣k(x̃(k))},(ii)
(38)[Iz̃(i)′QC1/2ũ*(k+i∣k)′R11/2QC1/2z̃(i)JiI0R11/2ũ*(k+i∣k)0JiI]≥0,{∀i∈{0,1,…,N-1},∀z̃(i)∈vert{χũ*(·∣k)k+i∣k(x̃(k))},(iii)
(39)[xii2I+μεiIz̃′z̃I]≥0,{∀i∈{0,1,…,N-1}∀z̃(i)∈vert{χũ*(·∣k)k+i∣k(x̃(k))},xii≤xii_max
subject to the shifted state constraints in (20), and μ is the weighting factor for the softened state constraints,(iv)
[uii2Iũ*(i∣k)′ũ*(i∣k)I]≥0, i=0,1,…,N-1, uii≤uii_max subject to the shifted input constraints in (19).Step 2.
Feed the plant by the inputũ(k)=ũ0(k∣k).Step 3.
x(k)=x̃(k)+xr(k), u(k)=ũ(k)+ur(k), k←k+1, and go to Step 1.The zero terminal equality poses difficulty to the optimization algorithm. Choosing the horizon lengthN may be challenging because, if N is not chosen to be long enough, RMPC scheme may not have a feasible solution. For the long prediction length N and for the large system, the online min-max optimization RMPC becomes more computational expensive. Another shortfall of the zero terminal equality constraint is that the solution to the minimization problem often takes unusual or unnatural paths in order to satisfy the constraint.Example 2.
We consider the same uncertain models in the example 1 and simulate the zero terminal equality RMPC scheme with a weighting factor for the softened state constraintsμ=1. The shortest horizon length for the closed-loop stability of this RMPC with the initial state x̃(0)=-xr=-[2.2-1.8] is N=6. The RMPC computation becomes more expensive since the total number of branches is β=26=64 or we have to calculate the zero terminal equality for 64 nodes of the terminal prediction states x̃(k+N∣k)=vert{χũ*(·∣k)k+N∣k(x̃(k))}=0.Figure5 compares the performance of the RMPC with a zero terminal equality and RMPC with a common Lyapunov function. We can see that the input of RMPC scheme with a zero terminal equality follows some unusual path in order to satisfy the terminal equality constraint, rather than yields a solution similar to the RMPC with a common Lyapunov function. Therefore, the output of RMPC with a zero terminal equality oscillates longer than that of RMPC with a common Lyapunov function. Or RMPC with a common Lyapunov function has a better performance than RMPC with zero terminal equality.Comparison of the two Tracking RMPC schemes.
(a)(b)


## 6. Conclusion

We have presented two tracking setpoint RMPC schemes with a common Lyapunov function and with a zero terminal equality subject to the saturated input and softened state constraints. It is assumed that all states of the MPC models are directly measured and that there are no disturbances. As the main advantage, soften state constraints scheme proves its ability to guarantee stability once the output setpoint leads to the violation of the state constraints.For the same prediction horizon length, softened state constraints RMPC becomes less conservative than RMPC with only hard input constraints. Another advantage of the softened state RMPC schemes is its ability to regulate the state violation by changing the weighting factor. RMPC scheme with longer prediction horizon approaches its setpoint faster than that with shorter prediction horizon. And with the same prediction horizon length, RMPC with a common Lyapunov function approaches its setpoint faster than RMPC with a zero terminal equality.However additional analysis is required to conclude the effectiveness of the novel schemes regarding to achievable performance and the corresponding CPU elapsed time because of the additional penalty terms added to the objective function. For long prediction lengths or/and in large systems, the online RMPC optimization becomes more computationally extensive. Results presented in this research must be viewed as an initial step towards a more comprehensive study on the theoretical properties of the softened state constraint schemes and their application.



---

*Source: 649461-2010-07-21.xml*