# Decreasing the Value of Specified Cost Function by Adaptive Controller Based on Modified ACLF for a Class of Nonlinear Systems

Authors: Keizo Okano; Kojiro Hagino; Hidetoshi Oya
Journal: Journal of Control Science and Engineering
 (2014)

---

## Abstract

A new nonlinear adaptive control law for a class of uncertain nonlinear systems is proposed. The proposed control law is designed by a modified adaptive control Lyapunov function (ACLF) which satisfies a Hamilton-Jacobi-Bellman (HJB) equation. The modified ACLF is derived from transformation of an ACLF. The proposed control law is different from the inverse optimal one in decreasing the value of a cost function specified by a designer. In this paper, we show a transformation coefficient for an ACLF and a design method of a nonlinear adaptive controller. Finally, it is shown by a numerical simulation that the proposed control law decreases the value of a given cost function and achieves the desirable trajectory.


---

## Body

## 1. Introduction

Design of control laws considering stability and optimality is the central issue in control theory [1]. For stability, Lyapunov theory is a strong tool to design controllers and to assure the stability of systems. For optimality, a value function which is the solution to a Hamilton-Jacobi-Bellman (HJB) equation is derived from dynamic programming. If a value function and an optimal control law can be found, then the closed system possesses robustness such as gain margin, phase margin, and low sensitivity against parameter variations [2, 3].However, a general approach to find the value function has not been shown and it is not easy to design the optimal control. Due to the difficulty, the inverse optimal control problem which minimizes a meaningful cost function was proposed by Freeman and Kokotovic. If the inverse optimal problem is solved, namely, a control Lyapunov function (CLF) is found, it is possible to design a control law with the good characteristics mentioned above by applying a CLF to the Pointwise Min-Norm (PMN) control law [4]. But the minimized cost function and the trajectory may not be desirable. In order to improve this problem, a locally approximate approach around the origin by numerical calculation and transformation of a CLF was proposed. The approach gives characteristics of local optimality without loss of characteristics of the global inverse optimality [5, 6], and it is based on the fact that the PMN control law can minimize the desired cost function if a CLF has the same level sets as the value function [7].The inverse optimal control law was applied to robust control and adaptive control [8, 9]. Moreover, a control law in which a Sontag type control law and a PMN control law were generalized has been proposed [10–12]. Also, many approaches to approximate the value function have been proposed. They are based on numerical calculation and focus on improvement of calculation speed and accuracy of approximation [5, 13].Recently, a new approach has been provided by [14]. The new approach in [14] is different from the inverse optimal and approximate approaches in directly considering a cost function specified by a designer and provides a modified ACLF by introducing a transformation coefficient. This paper expands [14] and proves a modified ACLF and a control law designed by a modified ACLF minimize the value of a cost function specified by a designer in the set of control laws based on an ACLF. Also, the condition under which a controller and a transformation coefficient are continuous is provided and the problem of overparameterization which is to increase the number of parameter estimation according to the order of a system is solved.In this paper, the design of a modified ACLF and a nonlinear adaptive control law is shown in Sections3 and 4 and effectiveness of the proposed controller is shown by a numerical simulation in Section 5.The following notations are used in this paper.R denotes the sets of real value. R+ denotes the sets of positive real value. Vx(x) denotes the derivative of V(x) with respect to x. For a matrix A, A>0(≥0) denotes that a matrix A is positive definite (semipositive definite) matrix. AT denotes transpose of matrix A.


## 2. Preliminaries

We deal with a nonlinear strict-feedback system with unknown parameters described by(1)x˙it=fix1,…,xi+FiT(x1,…,xi)θ+gix1,…,xixi+1t,x˙nt=fnx1,…,xn+FnT(x1,…,xn)θ+gnx1,…,xnut,
where i=1,…,n-1, xi(t)∈R, u(t)∈R, and θ∈Rp denote the state, the control input, and a vector of unknown constant parameters, respectively. It is assumed in this paper that all information of the state x(t) can be used. fix1(t),…,xi(t):Ri→R and Fix1(t),…,xi(t):Ri→Rp satisfy fi(0)=0 and Fi(0)=0, respectively. gix1(t),…,xi(t):Ri→R is not equal to 0 for all x. In compact notation, the system (1) is described as
(2)x˙t=fx+FTxθ+gxut,
where f(x)=[f1(x1)+g1(x1)x2(t),…,fi(x1,…,xi)+gi(x1,…,xi)xi+1(t),…,fn(x1,…,xn)]T, F(x)=[F1(x1),…,Fn(x1,…,xn)]T, and g(x)=[0,…,0,gn(x1,…,xn)]T are smooth and f(0)=0, F(0)=0, so that x=0 is an equilibrium of the uncontrolled plant. In order to estimate the unknown parameter θ∈Rp, the following adaptive law is introduced:
(3)θ^˙t=Γτx,θ^,
where θ^∈Rp is the estimation of the parameter θ, Γ=ΓT>0∈Rp×p is a constant parameter specified by a designer, and τ(x,θ^):Rn+p→Rp is the tuning function. The construction of the tuning function is explained in Section 4.The cost function is defined as(4)J=∫0∞‍L(x,u)dt=∫0∞‍qx+rxu2tdt,
where q(x):Rn→R and r(x):Rn→R are weighting functions and satisfy q(x)>0 for all x≠0, q(0)=0, and r(x)>0 for all x.It is well known that the optimal control problem which minimizes the cost function (4) is reduced to the problem to find the value function satisfying the following HJB equation [10]:
(5)H¯x,θ^=L(x,u¯(t))+V¯˙(x,θ^)=q(x)+V¯xT(x,θ^)f(x)+FT(x)θ+V¯θ^T(x,θ^)Γτ(x,θ^)-14r(x)V¯xT(x,θ^)g(x)gT(x)V¯x(x,θ^)=0,
where the optimal control law u¯(t) is given by
(6)u¯t=-12rxgTxV¯xx,θ^.
However, it is generally difficult to solve the HJB equation and to find the value function. In this paper, assuming that there exists an ACLF for the system (1), a certain transformation coefficient is introduced and a nonlinear adaptive control law is constructed by a modified ACLF based on an original ACLF.


## 3. Main Results

In this section, we show the controller based on a modified ACLF by a certain transformation coefficient.First, an ACLF with unknown parameters and an adaptive law is defined as the following definition.Definition 1.
V
(
x
,
θ
^
)
:
R
n
+
p
→
R
+ is called an ACLF for the system (2) and (3) if it is a positive definite function which is continuous and radially unbounded and satisfies the following inequality:
(7)inf⁡u∈RVxT(x,θ^)f(x)+FT(x)θ+Vθ^T(x,θ^)Γτ(x,θ^)+VxTx,θ^gxut<0∀x≠0.
The following theorem gives the transformation coefficient for the modified ACLF and the control law based on an ACLF.Theorem 2.
It is assumed that there exists an ACLFV(x,θ^) for the system (2) and (3). Let V~(x,θ^) be
(8)V~x,θ^=∫0t‍kx,θ^ddtVx,θ^dt+C,
where k(x,θ^) is defined by (9a)kx,θ^=2rxσ1x,θ^+σ2x,θ^VxTx,θ^gxgTxVxx,θ^VxTx,θ^gx≠0,(9b)kx,θ^=-qxσ1x,θ^VxTx,θ^gx=0,(9c)kx,θ^=0(x=0)and σ1(x,θ^) and σ2(x,θ^) in (9a)–(9c) are scalar functions defined by
(10)σ1x,θ^=VxTx,θ^fx+FTxθ+Vθ^Tx,θ^Γτx,θ^,(11)σ2x,θ^=σ1x,θ^2+qxrxVxTx,θ^gxgTxVxx,θ^,
respectively. C denotes a constant and is sufficiently large so that V~(x,θ^) is a positive definite function. Then, k(x,θ^)>0 for all x≠0 and V~(x,θ^) satisfies HJB equation (5) with the following control input:
(12)u(t)=-k(x,θ^)2r(x)gT(x)Vx(x,θ^)
and the closed system with the control input (12) is asymptotically stable to the origin.Proof.
First, we show thatk(x,θ^) is given by (9a)–(9c) so that V~(x,θ^) satisfies HJB equation and k(x,θ^)>0 for all x≠0. In HJB equation (5), when V~˙(x,θ^) is applied instead of the value function V¯˙(x,θ^), the quadratic equation in terms of k(x,θ^) is derived by
(13)Hx,θ^=L(x,u)+V~˙(x,θ^)=q(x)+r(x)u2(t)+k(x,θ^)σ1(x,θ^)+VxT(x,θ^)g(x)u(t)=q(x)+k(x,θ^)σ1(x,θ^)-k2(x,θ^)4r(x)VxT(x,θ^)g(x)gT(x)Vx(x,θ^)=0,
where input u(t) is given by (12) from Hu(x,θ^)=0. Equation (13) can easily be solved with respect to k(x,θ^); namely, k(x,θ^)=(-b±b2-4ac)/2a in the case of a≠0 and k(x,θ^)=-c/b in the case of a=0 where a=VxT(x,θ^)g(x)g(x)TVx(x,θ^), b=σ1(x,θ^), and c=q(x) and the solution becomes(14a)kx,θ^=2rxσ1x,θ^±σ2x,θ^VxTx,θ^gxgTxVxx,θ^(VxT(x,θ^)g(x)≠0),(14b)kx,θ^=-qxσ1x,θ^VxTx,θ^gx=0.Though there are two solutions in (14a) when VxT(x,θ^)g(x)≠0, we select one of them as (9a). Then, k(x,θ^)>0 for all x≠0 because, in the case that VxT(x,θ^)g(x)≠0, σ1(x,θ^)≤(σ1(x,θ^))2<σ2(x,θ^) for all x≠0 and, in the case that VxT(x,θ^)g(x)=0, since V(x,θ^) is an ACLF which satisfies (7), σ1(x,θ^)<0 for all x≠0. Therefore, we obtain k(x,θ^)>0 for all x≠0.
Next, we will show that the system is asymptotically stable by the control law (9a)–(9c) and (12). In the case that VxT(x,θ^)g(x)≠0, the time derivative of V(x,θ^) is given by (16a). Since σ2(x,θ^)>0, we obtain V˙(x,θ^)<0. In the case that VxT(x,θ^)g(x)=0, the time derivative of V(x,θ^) is given by (16b). Consider
(15)V˙x,θ^=VxT(x,θ^)f(x)+FT(x)θ+Vθ^Tx,θ^Γτx,θ^+VxTx,θ^gxut,(16a)V˙x,θ^=-σ2x,θ^VxTx,θ^gx≠0,(16b)V˙x,θ^=σ1x,θ^VxTx,θ^gx=0.σ1(x,θ^)<0 because V(x,θ^) is an ACLF which satisfies (7). Therefore we also obtain V˙(x,θ^)<0 in the case of (16b) and V˙(x,θ^)<0 is satisfied for all x≠0. As a result, V(x,θ^) is the ACLF for the system (2) and (3) with the input (9a)–(9c) and (12). We show that V~(x,θ^) is also an ACLF. It is trivial that the time derivative of V~(x,θ^) is k(x,θ^)V˙(x,θ^)<0 for all x≠0 because k(x,θ^)>0 and V˙(x,θ^)<0 for all x≠0. Since V~(x(t),θ^(t)) changes its value with t similarly as V(x(t),θ^(t)) and V~˙(x(∞),θ^(∞))=0 and there always exists C to make V~(x(∞),θ^(∞))=0, we can have V~(x,θ^) be positive definite for all x≠0. Therefore, V~(x,θ^) is an ACLF for the system. Therefore, the solution of the system (2) and (3) converges to the maximum invariant sets S included in the set U={x∣V~˙(x,θ^)=0} by LaSalle’s invariance principle [15]. Since the invariant sets S consist of the origin only, the closed system is asymptotically stable to the origin.In Theorem2, the ACLF V(x,θ^) is modified by the transformation coefficient k(x,θ^) and the modified V~(x,θ^) is an ACLF and satisfies HJB equation.Theorems about the cost function (4), the transformation coefficient k(x,θ^), and the control input (12) are given as follows.Corollary 3.
The value of cost function is given by the following equation if the transformation coefficient (9a)–(9c) and control law (12) are applied:
(17)J=-∫0∞‍V~˙x,θ^dt.Proof.
Equation (18) is given from (13):
(18)Lx,u=-V~˙x,θ^.
By integrating of (18) from 0 to ∞, we obtain
(19)∫0∞‍L(x,u)dt=-∫0∞‍V~˙(x,θ^)dt.Theorem 4.
The control law (12) with (9a)–(9c) minimizes the cost function (4) in the set of control laws based on the ACLF V(x,θ^).Proof.
It is assumed that the control (20) stabilizes the system:
(20)ut=vt-kx,θ^2rxgTxVxx,θ^.
By substituting (20) for the cost function (4) and applying (13), we obtain
(21)J=∫0∞vt-kx,θ^2rxgTxVxx,θ^2q(x)+r(x)×vt-kx,θ^2rxgTxVxx,θ^2dt=-∫0∞‍k(x,θ^)VxT(x,θ^)×v-kx,θ^2rxgTxVxx,θ^f(x)+FT(x)θ+gxv-kx,θ^2rxgTxVxx,θ^dt-∫0∞‍k(x,θ^)Vθ^T(x,θ^)Γτ(x,θ^)dt+∫0∞‍r(x)vt2dt=-∫0∞‍kx,θ^V˙x,θ^dt+∫0∞‍rxvt2dt.
Since the first term in (21) is positive, (21) is minimized when v(t)=0. Therefore, the cost function (4) is minimized by the control law (12) using the ACLF V(x,θ^).Theorem 5.
Ifσ1(x,θ^), VxT(x,θ^)g(x), q(x), and r(x) are continuous and differentiable for all x≠0, then transformation coefficient (9a)–(9c) is continuous and differentiable for all x≠0.Proof.
H
(
x
,
θ
^
) of (13) can be regarded as the function of x(t) and k(x,θ^), namely, H(x,k). The derivative of the function H(x,k) with respect to k(x,θ^) is given by (22a)Hkx,kx,θ^=-σ2x,θ^VxTx,θ^gx≠0,(22b)Hkx,kx,θ^=σ1x,θ^VxTx,θ^gx=0,where we used (9a)–(9c). In (22a), σ2(x,θ^)>0 for all x≠0. In (22b), σ1(x,θ^)<0 for all x≠0 since V(x,θ^) is an ACLF. Therefore, Hk(x,k)<0 for all x≠0. From implicit function theorem, k(x,θ^) is continuous and differentiable for all x≠0 if σ1(x,θ^), VxT(x,θ^)g(x), q(x), and r(x) are continuous and differentiable for all x≠0.Remark 6.
It is assumed that the weighting functionq(x)>0 for all x≠0 in this paper. But even if σ1(x,θ^)≠0 when q(x)=0 for all x≠0, the proposed approach can also be applied (refer to Section 5).Remark 7.
The control law includes the unknown parameters in (10). Therefore, it is required to estimate them by an adaptive law. The adaptive law is given in Section 4.Remark 8.
The proposed approach does not provide the value function but the transformation coefficient is determined such that the modified ACLF (8) satisfies the HJB equation. Since the modified ACLF (8) depends on the original ACLF, the value of the cost function (17) varies depending on the selection of the original ACLF.


## 4. Application of Theorem2 to ACLF Obtained by Backstepping

In this section, the transformation coefficient, the modified ACLF, and a nonlinear adaptive control law are designed by applying Theorem2 to the ACLF which is chosen in the following backstepping. Backstepping can be applied to the strict-feedback system (1) by the following procedure [16].Step
i  (i=1,…,n). We introduce the variables of zi(t), αi(x¯i,θ^), and αn(x¯n,θ^) defined by (23) and (24):
(23)zit=Δxit-αi-1x¯i-1,θ^,(24)uBst=αnx¯n,θ^,
where x¯i=(x1,…,xi), αi(x¯i,θ^)∈Ri+p→R(i=1,…,n-1) are the virtual inputs and α0(x¯0,θ^)=0 and uBs(t) denotes the control law derived in the step n of backstepping. Differentiating (23) with respect to t and using (1), z system is written as
(25)z˙it=fi(x¯i)+FiT(x¯i)θ-α˙i-1(x¯i-1,θ^)+gix¯izi+1t+αix¯i,θ^,
where zn+1(t)=0 and α˙i(x¯i,θ^) is given by
(26)α˙ix¯i,θ^=∑j=1i‍∂αix¯i,θ^∂xjx˙jt+∂αix¯i,θ^∂θ^Tθ^˙t.
If the z system (25) is asymptotically stable, then the x system (1) is also asymptotically stable. Therefore, we solve the problem of stabilization of the z system by Lyapunov approach considering the Lyapunov function candidate as follows (in this paper, V⋆(·,θ^) denotes the ACLF derived by backstepping. u⋆(t), k⋆(x,θ^) denote the control law and the transformation coefficient based on V⋆(·,θ^), respectively):(27)Vi⋆z,θ^=12∑j=1i‍zj2t+12θ-θ^tTΓ-1θ-θ^t.
The virtual input αi(x¯i,θ^) is chosen as
(28)αix¯i,θ^=-1gix¯i×∂αi-1x¯i-1,θ^∂θ^Tgi-1(x¯i-1)zi-1(t)+cizi(t)+fi(x¯i)+wiTx¯i,θ^θ^t-∑j=1i-1‍∂αi-1x¯i-1,θ^∂xj×∂αi-1x¯i-1,θ^∂xjfjx¯j+gjx¯jxj+1t-∑j=1i-1‍zj(t)∂αj-1(x¯j-1,θ^)∂θ^TΓwi(x¯j,θ^)-∂αi-1x¯i-1,θ^∂θ^TΓ∑j=1i‍wjx¯j,θ^zjt,
where z0(t)=0 and ci∈R+ is a design parameter and
(29)wix¯i,θ^=Fix¯i-∑j=1i-1‍∂αi-1x¯i-1,θ^∂xjFjx¯j.
The time derivative of Vn⋆(z,θ^) along the solution of (25) in the Step i is given by
(30)V˙n⋆z,θ^=-∑i=1n‍cizi2t-∑i=1n‍zit∂αi-1x¯i-1,θ^∂θ^T+∑i=1n‍zit∂αi-1x¯i-1,θ^∂θ^Tθ-θ^tTΓ-1×θ^˙t-Γ∑i=1n‍wix¯i,θ^zit.If the tuning functionτ(x¯n,θ^) is chosen as
(31)θ^˙t=Γ∑i=1n‍wix¯i,θ^zit,
then we get
(32)V˙n⋆(z,θ^)=-∑i=1n‍cizi2(t)<0.
Thus, Vn⋆(z,θ^) is an adaptive Lyapunov function for the z system, the z system is asymptotically stable, and the estimation error θ-θ^ is stable; then x system is asymptotically stable. Since the adaptive Lyapunov function and the asymptotic stabilizing control law are given, Vn⋆(z,θ^) is an ACLF.Applying Theorem2 to ACLF (27), we obtain the control law u⋆(t) as
(33)u⋆t=-k⋆x¯n,θ^2rxVnxn⋆x¯n,θ^gnx¯n,
where the transformation coefficient k⋆(x¯n,θ^) is given by(34a)k⋆x¯n,θ^=2r(x¯n)σ1⋆(x¯n,θ^)+σ2⋆(x¯n,θ^)Vnxn⋆(x¯n,θ^)gn(x¯n)2(Vnxn⋆(x¯n,θ^)gn(x¯n)≠0),(34b)k⋆x¯n,θ^=-qx¯nσ1⋆x¯n,θ^Vnxn⋆x¯n,θ^gnx¯n=0,(34c)k⋆(x¯n,θ^)=0(x¯n=0)and σ1⋆(x¯n,θ^) and σ2⋆(x¯n,θ^) are given by
(35)σ1⋆x¯n,θ^=∑i=1n-1‍Vnxi⋆(x¯n,θ^)×fix¯i+FiTx¯iθ^+gix¯ixi+1t+Vnxn⋆(x¯n,θ^)fn(x¯n)+FnT(x¯n)θ^-∑i=1n‍xit-αi-1x¯i-1,θ^∂αi-1x¯i-1,θ^∂θ^T×Γ∑i=1n‍wix¯i,θ^xit-αi-1x¯i-1,θ^,σ2⋆(x¯n,θ^)=σ1⋆(x¯n,θ^)2+q(x¯n)r(x¯n)Vnxn⋆(x¯n,θ^)gn(x¯n)2
from the following which is rewritten by (23) and (27):
(36)Vn⋆x¯n,θ^=12∑i=1n‍xi(t)-αi-1(x¯i-1,θ^)2+12θ-θ^tTΓ-1θ-θ^t.Now, we show the stability of the system (2). The time derivative of (36) along the solution of (2) with the control input (33) yields(37a)V˙n⋆x¯n,θ^=-σ2⋆x¯n,θ^Vnxn⋆x¯n,θ^gnx¯n≠0,(37b)V˙n⋆x¯n,θ^=σ1⋆x¯n,θ^Vnxn⋆x¯n,θ^gnx¯n=0.Since Vnxn⋆(x¯n,θ^)gn(x¯n)=zn(t)gn(x¯n) and zn(t)=0, (37b) becomes
(38)σ1⋆z,θ^=-∑i=1n-1‍cizi2t<0(Vnxn⋆(x¯n,θ^)gn(x¯n)=0)
from (32). Now, it is shown that (36) is an adaptive Lyapunov function and the system is, therefore, asymptotically stable to the origin.Finally, we show thatV~(x¯n,θ^) which is related to V(x¯n,θ^) by (8) satisfies HJB equation. Using V~(x¯n,θ^) instead of V¯(x¯n,θ^), we obtain HJB equation (39) for the system (1) and (3) with the cost function (4):
(39)Hx¯n,θ^=q(x¯n)+k⋆(x¯n,θ^)∑i=1n-1‍Vxi⋆(x¯n,θ^)×fix¯i+FiTx¯iθ+gix¯ixi+1t+k⋆x¯n,θ^Vxn⋆x¯n,θ^fnx¯n+FnTx¯nθ+k⋆(x¯n,θ^)∑i=1n‍Vθ^⋆(x¯n,θ^)Γτ(x¯n,θ^)-14rx¯nk⋆x¯n,θ^Vxn⋆x¯n,θ^gnx¯n2.
By substituting (34a)–(34c) into (39), it is shown that HJB equation is satisfied.From the above, it is confirmed that Theorem2 is satisfied.


## 5. Numerical Example

The effectiveness of the proposed control law is shown by a numerical example of a system with an unknown parameter. The numerical simulation is done for the second order system (40) and the cost function (41) [10]:
(40)x˙1(t)=x2(t)x˙2t=-x1tπ2+arctan5x1t-5x12t21+25x12t+3.5+θx2t+3ut,(41)J=∫0∞‍x22(t)+u2(t)dt,
where the true value of the unknown parameter is θ=0.5.The value function of the optimal control problem for the system (40) with the cost function (41) is given by the following equation if the true value of θ in (40) is 0.5 (the value function of the HJB equation is given in the existing result [10]):(42)V¯(x¯2)=x12tπ2+arctan5x1t+x22(t)
and the optimal control law is u¯(t)=-3x2(t) from (6).On the other hand, using the ACLF which is given by (43) from (27),
(43)V2⋆x¯2=121Γx12(t)+c1x1(t)+x2(t)2+1Γθ-θ^t2,
the control law is derived as (44) by backstepping:
(44)uBst=13x1(t)π2+arctan5x1(t)-c1c2-1+5x12(t)21+25x12(t)-π2x2tc1+c2+3.5+θ^t.
Then, applying Theorem 2 to ACLF (43), the proposed control is
(45)u⋆(t)=-32k⋆(x¯2)c1x1(t)+x2(t)
and the transformation coefficient is(46a)k⋆x¯2=2σ1⋆x¯2,θ^+σ1⋆(x¯2,θ^)2+3x2(t)c1x1(t)+x2(t)23c1x1(t)+x2(t)2V2x2⋆Tx¯2gx¯2≠0,(46b)k⋆x¯2=-x22σ1⋆x,θ^V2x2⋆Tx¯2gx¯2=0,(46c)k⋆x¯2=0x¯2=0,(47)σ1⋆x¯2,θ^=x1(t)x2(t)-c1x1(t)+x2(t)×x1tπ2+arctan5x1t+5x12(t)21+25x12t-π2+arctan5x1t+5x12(t)21+25x12tx2tc1+3.5+θ^t.It should be noted that ifx1(t)≠0 and x2(t)=0, then q(x¯2)=0. In this case, we need to show that σ1⋆(x¯2,θ^)≠0 mentioned in Remark 6. Actually, we can obtain (48) from (47) when x2(t)=0:
(48)σ1⋆x¯2,θ^=-c1x12(t)π2+arctan(5x1(t))-5c1x13t21+25x12t<0qx=0.
Therefore, the proposed approach can be applied to ACLF (43).The simulation results are shown in Figures1, 2, 3, and 4. The initial state is x¯2(0)=-1.05.0 and design parameters are ci=1 and Γ=1. The value of the cost function J is shown in Table 1.Table 1
CostJ.
Optimal
Proposed
Backstepping
25.3
25.4
31.0Figure 1
Time histories ofx1(t).Figure 2
Time histories ofx2(t).Figure 3
Time histories ofu(t).Figure 4
Time history ofk(x,θ^).Figures1–3 show that the trajectories by the proposed control law are close to the optimal trajectories and Table 1 shows that the value of the cost function by the proposed control law is smaller than the one by backstepping and close to the optimal value for the system of which parameter θ is known.


## 6. Conclusions

In this paper, a nonlinear adaptive control law is proposed. The control law is designed by a modified ACLF which satisfies the HJB equation. It is proved that a cost function specified by a designer is minimized in the set of the control laws based on an ACLF for the strict-feedback system. The condition under which the proposed control law and the transformation coefficient are continuous is provided. The effectiveness of the proposed control law is shown by the simple numerical simulation.If an ACLF is given, then the proposed approach enables designing a control law. Therefore, the proposed approach can also be applied to other nonlinear systems compared to strict-feedback systems.Research subject in the future is extension to systems in which all the states cannot be accessed.



---

*Source: 280951-2014-11-24.xml*