# Iterative Data-Driven Control for Closed Loop with Two Unknown Controllers

Authors: Hong Jianwang; Ricardo A. Ramirez-Mendoza; Ruben Morales-Menendez
Journal: Mathematical Problems in Engineering
 (2021)

---

## Abstract

Iterative idea is combined with data-driven control and is used to design the feedforward controller and feedback controller simultaneously. Consider one closed loop system with two controllers, the classical model-based control holds on the condition of known plant. To alleviate the modeling process for plant, data-driven control is applied to design the two controllers. After these two controllers are parametrized by two unknown parameter vectors, the iterative idea is introduced to identify these two parameter vectors. Furthermore, for more general case of controllers, the closed relations between controllers and expected transfer functions are derived. Then, the iterative idea is also introduced to achieve the controller design. To be of benefit for latter stability analysis, some equities are derived for output-input sensitivity functions with three kinds of disturbances. Generally, after formulating the problem of the controller design as one model-matching problem, the purpose of this paper is threefold. First, we derive that, in case of two parametrized controllers, the iterative idea is performed to identify these two unknown parameter vectors, even when parameters converge to their true values. Second, we show how to design the two controllers iteratively for more general forms and find the closed relations between these controllers and expected closed loop transfer functions. Third, we provide some heuristic considerations on output-input sensitivity functions, which are of benefit for our stability analysis on data-driven control. Finally, one example is given to show the feasibility of our proposed theories.


---

## Body

## 1. Introduction

Data-driven control is one new advanced control strategy in theory and practice, due to its lack of system modeling process. Classical control strategy, i.e., model-based control, depends on the mathematical model greatly of the considered system or plant. More specifically, when to control one plant in the open loop or closed loop, the first step is to construct one mathematical model for this plant by using first principle or system identification; then, this obtained mathematical model is applied for the latter controller design or other missions. During the last 60 years, the main task of system identification concerns on finding one approximated model to best fit the observed input-output data. Based on this approximated model, a suitable controller is designed under the condition that this identified model converges to its real system. Generally, model-based control includes two steps: system identification and controller design. In recent years, researchers are thinking about how to combine these two steps, i.e., designing controller directly from the observed input-output data. Then, data-driven control is generated to achieve the controller design from data without the modeling process. Especially during our information age, lots of observed data are very easy to yield, so it is necessary to study data-driven control and apply it in some real engineering fields, such as paper production, glass production, and separation process like crystallization. To alleviate the dependence on the identified model for the controller, the notion of the data-driven approach is widely studied in recent years. The attracting property of the data-driven approach is that the controller is designed directly based on measured data. As the data-driven approach is still in its infancy, different names are called in the references to describe it, such as data-driven, data-based, and model-free. To the best of our knowledge, the principles between data-driven approach and system identification are similar to each other, as the measured data are applied to get the mathematical model for the unknown plant in the framework of system identification, but get the approximated controller for the case of the data-driven approach. The idea of direct data-driven control was first proposed in machine learning; then, it attracted many researchers in the advanced control field recently. Now, this data-driven theory is widely applied in the control field, for example, direct data-driven control, data-driven estimation, data-driven detection, and data-driven optimization. The common property among them is that the measured data are used to achieve our main goals; then, it means some useful information are extracted from these measured data. On the contrary, the data-driven approach needs lots of measured data, i.e., the number of measured data is sufficiently large. This requirement is feasible in our information period, and the data-driven approach was born to overcome the limitation of the model-based approach, so the data-driven approach is studied very popularly from theory and practice application.Due to no model identification process for data-driven control, the unknown controllers, whatever feedback controller and feedforward controller, are yielded through the observed input-output data. We say that lots of information exist in observed data, for example, information for system modeling, information for controller design, and information for fault detection. The first is named as system identification, which is studied during these 40 years, but the second corresponds to data-driven control, proposed in these 10 years, so the research on system identification is very mature, such as identification algorithm and convergence analysis. In these 10 years, many detailed strategies for data-driven control are proposed to generate the controller from observed data, for example, virtual reference feedback tuning control, subspace predictive control, iterative correction tuning control, and set membership predictive control. All the above data-driven control strategies hold on the condition that the observed data must be persistent exciting or data informative, and it means all the implicit modes in system and controllers are excited perfectly; then, their complete properties are included in the observed data. The task of data-driven control is to apply some ways to extract these useful properties for the system (system identification) and controller (data-driven control). By the way, the third information for fault detection corresponds to testify the faults from the observed data, specifically in UAVs’ formation control and modern war. For example, in recent years, we have succeeded in applying ellipsoidal approximation in target tracking for multi-UAVs’ formation cooperative detection. Its essence is to identify the unknown state from the observed data, as some important factors are in the state estimation.The idea of data driven can be combined with other control strategies, such as adaptive control, internal model control, robust control, and model predictive control. It is similar to a new concept-identification for control, proposed in 2010s, to combine system identification and other control strategies. Consider the case of data-driven model predictive control, system identification is used to identify one function estimation; then, this obtained function estimation is substituted into the cost function for model predictive control. As the number of references on data-driven control is vast, we cannot list all of them here, so some are given to be suitable for our own study. Data-driven control is applied to minimize the energy consumption in [1], where the mathematical equation for the energy consumption is constructed as one linear state space system. Formulas for data-driven control are analyzed, such as stabilization, optimality, and robustness in [2], where the detailed linear feedback controller is expressed as one matrix form about the data Hankel matrix. The closed relations between model-based control and data-driven control are studied to point out the perspective for data-driven control [3]. Consider one nonlinear feedback loop system [4], data-driven control is introduced to design controllers with two degrees of freedoms. And, set membership identification is more widely studied for the case of unknown but bounded noise. Campi and Weyer [5] proposed one new data-driven control strategy, i.e., virtual reference feedback tuning control; furthermore, finite sample properties of it are derived for the finite sample data points. Then, this sample complexity is considered for the classical linear quadratic regulator [6]; as a consequence, this sample complexity is the required number of data points which makes the control performance to achieve the desired one. Last year, some researchers started to derive data informativity for data-driven analysis and control [7], from the point of persistency excitation [8]. One important condition on optimal input must be satisfied to guarantee the Hankel matrix be full rank. As reinforcement learning is very popular now, so this reinforcement learning will be also introduced in control theory [9]; it tells reinforcement learning will be a hot subject for data-driven control in future. During these 3 years, we also publish some contributions on data-driven control, for example, zonotope parameter identification for data-driven control [10] and finite sample properties for data-driven control [11]. The idea about combining data-driven control with adaptive control is seen in [12], where Lyapunov stability is applied to derive one parameter adjustment law, satisfying the stability for the whole adaptive system. Research on piecewise affine system identification are still done, for example, Bianchi and Breschi [13] developed a general framework to alternate between parameter estimation and sample mode assignment. In reference [14], given a set of input-output data, the identification of a switched nonlinear system for the underlying system involves the simultaneous identification of the mode sequence. Due to the application of the data-driven approach widely in the control field and the similar point between data-driven approach and system identification, we call their combination as identification for control, i.e., system identification for direct data-driven control. More specifically, we describe a concise introduction or contribution on system identification for direct data-driven control, which belongs to the data-driven approach. In case of the unknown but bounded noise, one bounded error identification is proposed to identify the unknown systems with time varying parameters. Then, one feasible parameter set is constructed to include the unknown parameter with a given probability level. The problem about how to construct this confidence interval is solved by a linear approximation/programming approach [15], which can identify the unknown parameter only for the linear regression model.Based on our previous contributions on data-driven control [10–12], this paper introduces the iterative idea into data-driven control, as the iterative idea exists in theory and practice more widely. Roughly speaking, the parameter converges to its true values as an iterative form until the estimation error be zero. Consider one closed loop system with two degrees of freedom controllers, i.e., feedback controller and feedforward controller, data-driven control strategy is used to design these two unknown controllers from the observed input-output data. When given the expected closed loop transfer function and expected sensitivity function, the problem of designing these two unknown controllers is reduced to one model-matching problem, whose optimization variables correspond to the two unknown controllers. Moreover, one cost function is constructed based on the observed input-output data for this model-matching problem. After formulating the problem of the controller design as one model-matching problem, the purpose of this paper is threefold. First, we derive that, in case of two parametrized controllers, the iterative idea is performed to identify these two unknown parameter vectors, even when parameters converge to their true values. Second, we show how to design the two controllers iteratively for more general forms and find the closed relations between these controllers and expected closed loop transfer functions. Third, we provide some heuristic considerations on output-input sensitivity functions, which are of benefit for our stability analysis on data-driven control.This paper is organized as follows. In Section2, the structure of the considered closed loop system with two unknown controllers i.e., feedback controller and feedforward controller, is formulated. For the sake of completeness, the classical model-based control is reviewed and one short introduction on data-driven control is also recalled from [10]. When the two unknown controllers are parametrized by two unknown parameter vectors, respectively, the iterative idea is proposed to identify these two unknown parameter vectors in Section 3, which means parameterized controllers design iteratively. Then, for more general forms on these two unknown controllers, the detailed relations between them and expected closed loop transfer function are established in Section 4; then, the iterative idea is applied again. In Section 5, more kinds of noise and disturbances are considered in this same closed loop system. Then, some derivations about output-input sensitivity functions are given for our latter stability analysis for data-driven control. In Section 6, one example shows the effectiveness of the proposed iterative controller design. Section 7 ends the paper with final conclusion and points out the next interesting subject. Here, in this paper, all the mathematical derivations are obtained by our own contributions.


## 2. Preliminaries

We start by recalling the results given in [10, 11].


### 2.1. Closed Loop System with Two Controllers

Consider one closed loop system with two controllers in Figure1.Figure 1
Closed loop system with two controllers.In Figure1, rt is the external input signal, Pz is the unknown plant, and it can be denoted as one proper rational transfer function form. C1z and C2z are two unknown controllers, i.e., feedforward controller and feedback controller, respectively. The main task of this paper is to design these two unknown controllers. ut and yt are the input and output for the considered plant Pz. dy is one kind of external disturbance, which will be extended in Section 5. εt=rt−C2zyt is the error signal, imposed on that feedforward controller C1z. During the framework of data-driven control, two unknown controllers C1z,C2z are designed based on the observed input-output data ut,yt, while avoiding the system identification process for that unknown plant Pz. z is one time shift operator, i.e., zut=ut−1.Observing Figure1 again, two controllers exist in that closed loop system simultaneously, i.e., the common unit feedback is replaced by feedback controller C2z. The benefit of these two controllers is that they cooperate with each other to achieve the control mission. More specifically, the considered closed loop with two controllers appears in some practical engineers, such as flight control, servo control, and predictive control.Consider that, in Figure1, we have the following relations such as(1)yt1=Pzut+dt=PzC1tεt+dt,εt=rt−C2tyt.From above equation (1), the complete input-output equation for rt,yt is that(2)yt=PzC1z1+PzC1zC2zrt+11+PzC1zC2zdt.Set the transfer function fromrt to yt be the closed loop transfer function, and similarly, the other transfer function from dt to yt is the sensitivity function. For the sake of completeness, the classical model-based control is formulated as follows, given the expected closed loop transfer function and expected sensitivity function as Mz and Sz; then, the problem of the controller design is to design the two controllers C1z,C2z so as to make the closed loop transfer function and sensitivity function be equal to their own expected forms Mz and Sz. Generally, the classical model-based control is formulated as the following model-reference problem:(3)minC1z,C2zJ1θ,η=PzC1z1+PzC1zC2z−Mz22+11+PzC1zC2z−Sz22,where .22 is Euclidean norm and C1z,C2z are two optimization variables.From [10], model reference problem (3) is solvable on the condition that plant Pz is known, so firstly the model identification process is needed to give one mathematical equation for that unknown plant Pz. To avoid this model identification process for plant Pz, data-driven control is applied.


### 2.2. Data-Driven Control

Based on the above description on classical model-based control, the reason about why that plantPz exists in cost function (3) is that the input-output data rt,yt are used for the whole closed loop system, not the input-output data ut,yt with respect to that unknown plant Pz. To be more precise, if the input-output data ut,yt around plant Pz are observed, some information about two unknown controllers C1z,C2z are included in these input-output data ut,yt, not rt,yt.Consider that given closed loop transfer functionMz, the relation between input ut and output yt is that(4)ut=C1z,θεt=C1z,θM−1z−C2z,ηyt.Similarly, consider that given sensitivity functionSz, it also holds that(5)ut=−C1z,θC2z,ηSzSz−1yt.Equations (4) and (5) are the relations for input ut and output yt, corresponding to the given closed loop transfer function Mz and given sensitivity function Sz. Combining equations (4) and (5) simultaneously, two unknown controllers C1z,C2z are designed through the following optimization problem:(6)minC1z,C2zJ2C1z,C2z=1N∑t=1Nut−C1zM−1z−C2zyt2+1N∑t=1Nut+C1zC2zSzSz−1yt2,where M−1z and S−1z are two inverse transfer functions and N is the number of observed data. From [10], that unknown pant Pz does not exist in cost function (6), i.e., no modeling process for plant Pz. Input-output data ut,ytt=1N are observed, and Mz,Sz are given, so only two controllers C1z,C2z are optimization variables in cost function (6). This is the essence for our considered data-driven control. All above detailed introduction on closed loop system and data-driven control are seen in our previous contributions [10, 11].


## 2.1. Closed Loop System with Two Controllers

Consider one closed loop system with two controllers in Figure1.Figure 1
Closed loop system with two controllers.In Figure1, rt is the external input signal, Pz is the unknown plant, and it can be denoted as one proper rational transfer function form. C1z and C2z are two unknown controllers, i.e., feedforward controller and feedback controller, respectively. The main task of this paper is to design these two unknown controllers. ut and yt are the input and output for the considered plant Pz. dy is one kind of external disturbance, which will be extended in Section 5. εt=rt−C2zyt is the error signal, imposed on that feedforward controller C1z. During the framework of data-driven control, two unknown controllers C1z,C2z are designed based on the observed input-output data ut,yt, while avoiding the system identification process for that unknown plant Pz. z is one time shift operator, i.e., zut=ut−1.Observing Figure1 again, two controllers exist in that closed loop system simultaneously, i.e., the common unit feedback is replaced by feedback controller C2z. The benefit of these two controllers is that they cooperate with each other to achieve the control mission. More specifically, the considered closed loop with two controllers appears in some practical engineers, such as flight control, servo control, and predictive control.Consider that, in Figure1, we have the following relations such as(1)yt1=Pzut+dt=PzC1tεt+dt,εt=rt−C2tyt.From above equation (1), the complete input-output equation for rt,yt is that(2)yt=PzC1z1+PzC1zC2zrt+11+PzC1zC2zdt.Set the transfer function fromrt to yt be the closed loop transfer function, and similarly, the other transfer function from dt to yt is the sensitivity function. For the sake of completeness, the classical model-based control is formulated as follows, given the expected closed loop transfer function and expected sensitivity function as Mz and Sz; then, the problem of the controller design is to design the two controllers C1z,C2z so as to make the closed loop transfer function and sensitivity function be equal to their own expected forms Mz and Sz. Generally, the classical model-based control is formulated as the following model-reference problem:(3)minC1z,C2zJ1θ,η=PzC1z1+PzC1zC2z−Mz22+11+PzC1zC2z−Sz22,where .22 is Euclidean norm and C1z,C2z are two optimization variables.From [10], model reference problem (3) is solvable on the condition that plant Pz is known, so firstly the model identification process is needed to give one mathematical equation for that unknown plant Pz. To avoid this model identification process for plant Pz, data-driven control is applied.


## 2.2. Data-Driven Control

Based on the above description on classical model-based control, the reason about why that plantPz exists in cost function (3) is that the input-output data rt,yt are used for the whole closed loop system, not the input-output data ut,yt with respect to that unknown plant Pz. To be more precise, if the input-output data ut,yt around plant Pz are observed, some information about two unknown controllers C1z,C2z are included in these input-output data ut,yt, not rt,yt.Consider that given closed loop transfer functionMz, the relation between input ut and output yt is that(4)ut=C1z,θεt=C1z,θM−1z−C2z,ηyt.Similarly, consider that given sensitivity functionSz, it also holds that(5)ut=−C1z,θC2z,ηSzSz−1yt.Equations (4) and (5) are the relations for input ut and output yt, corresponding to the given closed loop transfer function Mz and given sensitivity function Sz. Combining equations (4) and (5) simultaneously, two unknown controllers C1z,C2z are designed through the following optimization problem:(6)minC1z,C2zJ2C1z,C2z=1N∑t=1Nut−C1zM−1z−C2zyt2+1N∑t=1Nut+C1zC2zSzSz−1yt2,where M−1z and S−1z are two inverse transfer functions and N is the number of observed data. From [10], that unknown pant Pz does not exist in cost function (6), i.e., no modeling process for plant Pz. Input-output data ut,ytt=1N are observed, and Mz,Sz are given, so only two controllers C1z,C2z are optimization variables in cost function (6). This is the essence for our considered data-driven control. All above detailed introduction on closed loop system and data-driven control are seen in our previous contributions [10, 11].


## 3. Parametrized Controller Design

Parametrized controller is always common in practice, such as the PID controller. The merit of the parametrized controller is to change the formal controller design to one problem of parameter estimation. It means after the parameter is identified, then the controller is obtained through the simple substitution.For convenience, two controllersC1z,C2z are parametrized by two unknown parameter vectors θ and η, respectively, i.e., C1z,θ,C2z,η. As a consequence, the parametrized forms are listed as follows:(7)C1z,θ=αTzθ,C2z,η=βTzη,αz=α1z,α2z,…,αnzT,βz=β1z,β2z,…,βnzT,θ=θ1,θ2,…,θnT,η=η1,η2,…,ηnT,where in equation (7), αz and βz are two known orthogonal basic functions and θ,η are tow unknown parameter vectors with suitable dimension n. After two unknown controllers C1z,C2z are parametrized by two unknown parameter vectors θ,η, i.e., C1z,C2z, then corresponding optimization problem (6) is rewritten as that(8)minθ,ηJ3θ,η=1N∑t=1Nut−C1z,θM−1z−C2z,ηyt2+1N∑t=1Nut+C1z,θC2z,ηSzSz−1yt2.And, the parametrized closed loop system is replotted in Figure2.Figure 2
Closed loop system with two parametrized controllers.Observing optimization problems (6) and (7), the controller design is reduced to identify those unknown parameter vectors θ,η. As the pointwise infimum of a family of affine function of θ,η is concave, so those two terms in equation (7) are convex function. Moreover, the first term is rewritten as(9)ut−C1z,θM−1z−C2z,ηyt=ut−αTzθM−1zyt−αTzθβTzηyt.It corresponds to one geometric programming; then, use the variables defined asx=logθ and y=logη, so θ=ex and η=ey, and it can be changed as one simple linear optimization problem. There are lots of optimization methods for solving equation (7), such as least squares method, first order gradient method, and set membership method. Whatever optimization methods are used, the iterative idea is introduced to identify the two unknown parameter vectors θ,η. Generally, the complete parameter estimation process with the iterative idea is formulated as follows.Step 1: given two initial parameter vectorsθ0,η0.Step 2: compute the first parameter vector through solving the following optimization problem, and denote it asθ^1:(10)θ^1=argminθJ3θ,η0=1N∑t=1Nut−C1z,θM−1z−C2z,η0yt2+1N∑t=1Nut+C1z,θC2z,η0SzSz−1yt2.Step 3: similarly, compute the second parameter vector through solving one optimization problem, and denote it asη^1:(11)η^1=argminηJ3θ0,η=1N∑t=1Nut−C1z,θM−1z−C2z,ηyt2+1N∑t=1Nut+C1z,θC2z,ηSzSz−1yt2.Step 4: iterate to generate parameter estimationθ^2:(12)θ^2=argminθJ3θ,η^1=1N∑t=1Nut−C1z,θM−1z−C2z,η^1yt2+1N∑t=1Nut+C1z,θC2z,η^1SzSz−1yt2.Step 5: iterate to generate parameter estimationη^2:(13)η^2=argminηJ3θ^1,η=1N∑t=1Nut−C1z,θ^1M−1z−C2z,ηyt2+1N∑t=1Nut+C1z,θ^1C2z,ηSzSz−1yt2.Stepi: based on the obtained parameter estimations θ^i−1,η^i−1, the new parameter estimations θ^i,η^i are computed iteratively:(14)θ^i=argminθJ3θ,η^i−1,η^i=argminηJ3θ^i−1,η.When the following inequality holds, then terminate the above iterative process:(15)θ^i−θ^i−12+η^i−η^i−12≤ɛ,where ϵ is one positive value with sufficient small, for example, ɛ=0.1.Equation (14) embodies our iterative idea, and it means when to compute the ith parameter estimation θ^i, the other parameter estimation η in the cost function is substituted by its i−1th parameter estimation η^i−1. And, it is the same process for computing η^i.


## 4. Iterative Controller Design

The parametrized controllersC1z,θ,C2z,η are considered in Section 3, where the problem of the controller design is changed to the parameter estimation. As those two unknown parameter vectors θ,η exist in cost function (7) as the multiply form, so our proposed iterative idea is introduced to identify them separately. During all of our previous contributions, we do not concern on the closed relations between the close loop transfer functions and their expected forms Mz,Sz. Here, our tasks are to find these closed relations and apply them into design more general controllers C1z,C2z iteratively.Combining equations (4) and (5), two controllers C1z,C2z must satisfy that(16)C1zM−1z−C2zyt=−C1zC2zSzSz−1yt.It means that(17)M−1z−C2z=−C2zSzSz−1,Sz−1M−1z−Sz−1C2z=−C2zSz,Sz−1M−1z+C2z=0.Then, feedback controllerC2z is yielded as follows:(18)C2z=1−SzMz.Equation (18) shows after we have the expected closed loop transfer function Mz and expected sensitivity function Sz, then feedback controller C2z is easily obtained from equation (18), so the next question is to get the other feedforward controller C1z. After simple but tedious calculations, we have the following equities:(19)C2zMz=PzC1zC2z1+PzC1zC2z,1−C2zMz=1−PzC1zC2z1+PzC1zC2z=11+PzC1zC2z,1−C2zMzPzMz=Pz1+PzC1zC2z×1+PzC1zC2zPzC1z,=1C1z.Then, the feedforward controllerC1z is yielded as that(20)C1z=Mz1−C2zMzPz,and substituting equation (18) into (20), then we have(21)C1z=Mz1−C2zMzPz=MzSzPz.Observing equations (18) and (21), when Mz and Sz are known in advance, then feedback controller C2z is obtained easily, but plant Pz is needed to derive the feedforward controller C1z. As a consequence, feedback controller C2z can be generated from these two expected transfer functions Mz,Sz, but information of plant Pz is needed in feedforward controller C1z. Here, the problem about information Pz and designing C1z can be handled by the iterative idea. Generally, the complete controller design process for more general controllers is formulated as follows:Step 1: given two expected or design transfer functionsMz,SzStep 2: compute the feedback controllerC2z directly by(22)C2z=1−SzMz.Step 3: choose one initial feedforward controllerC10z as(23)C10z=MzSzP0z,whereP0z is the initial plantStep 4: usingC10z and fixed C2z, determine plant P1z as(24)P1z=argminPzPzC10z1+PzC10zC2z−Mz22.Step 5: substituteP1z into C1z to give one new feedforward controller C11z, i.e.,(25)C11z=MzSzP1z.Stepi: iterate to compute the ith plant Piz and the ith feedforward controller C1iz:(26)Piz=argminPzPzC1i−1z1+PzC1i−1zC2z−Mz22,C1iz=MzSzPiz.When the following inequity holds, then terminate the above iterative process:(27)Piz−Piz2+C1iz−C1i−1z2≤ɛ.Comment: the above iterative process solves the identification for plantPz and feedforward controller C1z, as feedback controller C2z is known from the given transfer functions Mz,Sz. Then, the the iterative process is related with plant Pz and feedforward controller C1z within the framework of data driven control.


## 5. Design Analysis

The above theoretical analysis about the iterative design for data-driven control concerns on the closed loop system in Figure1. As only output disturbance dt exists in Figure 1, so it is one ideal case. But on the contrary in practice, maybe three kinds of disturbances appear in the considered closed loop system in Figure 3, i.e., output disturbance, input disturbance, and measurement noise.Figure 3
Extended closed loop system with three disturbances.In Figure3, dt denotes output disturbance, d1t denotes the input disturbance, and d2t is measurement noise.Similarly, for Figure3, some relations hold based on the linear system theory. For notational clarity, we abbreviate the parameter vectors θ,η in following mathematical derivations:(28)yt=dt+Pzut=dt+Pzd1t+C1zrt−C2zyt+d2t,i.e.,(29)1+PzC1zC2zyt=dt+Pzd1t+PzC1zrt−PzC1zC2zd2t.Then,(30)yt=dt+Pzd1t+PzC1zrt1+PzC1zC2z−PzC1zC2zd2t1+PzC1zC2z.From equation (30), one transfer function from output disturbance dt to plant output yt is defined as follows, i.e., output sensitivity function:(31)Sydz=11+PzC1zC2z.Similarly, the transfer function from measurement noise disturbanced2t to plant output yt is that noise sensitivity function:(32)Syd2z=−PzC1zC2z1+PzC1zC2z.The transfer function from input disturbanced1t to plant output yt is that(33)Syd1z=−Pz1+PzC1zC2z.The transfer function from excited inputrt to plant output yt holds that(34)Syrz=PzC1z1+PzC1zC2z.Observing equations (31) and (32), it holds that(35)Sydz−Syd2z=1.If considered in the frequency domain, we have(36)Sydz+Syd2z=1.Similarly, from equations (31) and (34), we have(37)Sydz+Syrz=1.Denote byS1z as the change of closed loop transfer function Syrz with the change of plant Pz. Then, this S1z is derived as follows in detail:(38)S1z=∂Syrz/Syrz∂Pz/Pz=∂Syrz∂Pz×PzSyrz.From equation (34), ∂Syrz/∂Pz is computed as follows:(39)∂Syrz∂Pz=C1z1+PzC1zC2z1+PzC1zC2z2−PzC1zC1zC2z1+PzC1zC2z2=C1z1+PzC1zC2z2,and combining equation (38) into (39), we see that(40)S1z=∂Syrz∂Pz×PzSyrz=C1z1+PzC1zC2z2×Pz×1+PzC1zC2zPzC1z=11+PzC1zC2z.From equations (40) and (32), we get(41)S1z−Syd2z=11+PzC1zC2z+PzC1zC2z1+PzC1zC2z=1.Equation (41) tells us that closed loop transfer function Syrz will always change with plant Pz, but with plant Pz changes, one equity always holds.The above analysis corresponds to the output sensitivity function. But the input sensitivity function is extremely important in the design of the underlying linear controller used in adaptive control. More specifically, the modulus of the input sensitivity function should be low at high frequencies in order to assure a good robustness of the system with respect to additive unstructured uncertainties located in the high frequency region.From equation (30), we have(42)yt−dt=dt+Pzd1t+PzC1zrt1+PzC1zC2z−PzC1zC2zd2t1+PzC1zC2z−dt=Pzd1t1+PzC1zC2z+PzC1zrt1+PzC1zC2z−PzC1zC2zd2t1+PzC1zC2z−PzC1zC2zdt1+PzC1zC2z.Then,(43)ut=d1t1+PzC1zC2z+C1zrt1+PzC1zC2z−C1zC2zd2t1+PzC1zC2z−C1zC2zdt1+PzC1zC2z.Similarly, four input sensitivity functions are defined as(44)Sudz=−C1zC2z1+PzC1zC2z,Surz=C1z1+PzC1zC2z,Sud1z=11+PzC1zC2z,Sud2z=−C1zC2z1+PzC1zC2z.Similarly, setS2z as the change of the input sensitivity function Sudz with the change of plant Pz, i.e., S2z is given that(45)S2z=∂Sudz∂Pz×PzSudz=C12zC22z1+PzC1zC2z2×Pz×1+PzC1zC2zC1zC2z=PzC1zC2z1+PzC1zC2z.Then, it holds that(46)S2z+Sud1z=1.Similarly, we also have that(47)∂Surz∂Pz×PzSurz+Sud1z=1.Equation (46) means that the relation about the input sensitivity function Sudz changes with plant Pz, and equation (47) shows the input sensitivity function Surz varies with plant Pz. Then, similarly, other equations hold for other input sensitivity functions Sud1z and Sud2z.


## 6. Simulation Example

Now, we propose one example to illustrate the nature of the above results. Then, the data-driven control strategy is applied in controlling one brake-by-wire system whose structure is plotted in Figure4.Figure 4
Brake-by-wire system.The brake-by-wire (BBW) technology basically cuts the physical link between the pedal and the braking system itself. Nowadays, almost every car in the world has conventional braking systems, and the pedal is directly connected to the brakes to apply the pressure to the wheels. For BBW systems, sensors and actuators read the amount of pressure the driver applies to the pedal, and this force is transferred to all the brakes by the braking actuator. The automotive industries have been focused on improving the performance of braking systems when talking about safety and efficiency; for that, brake-by-wire systems have continuously been studied and enhanced. A BBW system is mainly composed by a pedal which sends a braking signal to an ECU where the signal is processed and some control algorithms are executed, and as an output, an electrical signal is sent to a dc motor which transmits the movement to an actuator for generating pressure over the braking pads to perform the braking action desired by the driver. A main characteristic of a BBW system is the type of actuator that is being employed; there are electrohydraulic (EHB) and electromechanical (EMB) actuators. The main difference between them is that EHB is based on an hydraulic system triggered by an electric motor or pump, while the EMB just employs an electric motor as an actuator for generating braking torque.The closed loop control is the most common scheme for controlling systems. For this scheme, 2 controllers were tested, the SMC and the PID. Both controllers were designed based on the data-driven control. As the closed loop controllers needed to be improved in speed (from responses of hundred of milliseconds to few milliseconds), a feedforward control was proposed. The signals pressure-current in open loop was plotted and analyzed. As can be observed, the system describes a kind of exponential form with hysteresis. On the contrary, the plot generated by the error between the system with the best PID control and the system response represent a polynomial with hysteresis. The experimentation setup was determined. A set of experimentations were delimited in order to extract from the laboratory BBW system the most relevant information e.g., the rise time, current vs. position relationship, and pressure vs. position relationship.Experiments’ considerations:(a)
A position sweep is necessary to verify the longitudes of the dead zone and the operative zone(b)
If the position of the dead zone and the active zone is the same, all the experiments will start in the dead zone (from constant current (4 amperes)). This experiment aims to graph the dead zone and the operative zone for the master piston of the system.The master piston has 2 main states, dead zone and operative zone, and a characterization map was realized in order to obtain a direct relation between the piston position and the pressure generated into the calipers. The setpoint signal for this experiment will be a step signal with 4 amperes of magnitude that will be fed to the system in order to obtain the position and pressure responses.The most effective closed loop structure for BBW is given in Figure5, where the pressure controller is the feedforward controller and the feedback effect corresponds to position control. At the cost of an additional measure, the piston position proves dynamically favorable for the control of the BBW system.Figure 5
Closed loop structure BBW.To analyze the data, the input signals as well as outputs of the 12 experiments are plotted in 5 different graphics: current displacement, current pressure, displacement pressure, time displacement, and time pressure. The graphics are shown in Figure6; furthermore, two more graphics are obtained by plotting the displacement and pressure against the time as it is shown in Figure 7.Figure 6
5 different graphics.Figure 7
Other two graphics.Assume that the BBW system is one linear system, whose transfer function form is given as(48)Pz=z−1.2z−0.4zz−0.3z−0.8.The pressure controller in feedforward partC1z,θ is used as(49)C1z,θ=αTzθ=z2z2−zzz2−z1z2−zθ1θ2θ3.Its true form is given as(50)C1z,θ=αTzθ=z2z2−zzz2−z1z2−z0.860.20.1,where this true form is unknown, and it is used to analyze the controller performance here.The expected closed loop transfer functionMz is chosen as that(51)Mz=zz−10.86z4−1.1z3+3.9z2+0.8z+0.48z7−3z6−0.96z5−0.72z4−0.93z3+3.9z2+0.8z+0.48.No expected sensitivity functionSz is considered, i.e., Sz=0. Then, based on equation (18), feedback controller, i.e., position controller, is that(52)C2z=1−SZMz=1Mz.Applying those input signals in Figures6 and 7 in the considered closed loop system and collecting the corresponding output signals, set the number of data points be 2000, and then, data-driven control and iterative idea are proposed to identify that unknown plant Pz and design the pressure controller C1z. The initial parameters, existing in C1z, are set as follows:(53)θ=0.750.250.15T.Due toMz and Sz are given in advance, then C2z=1−SZ/Mz=1/Mz is easily yielded. To show the control performance for designing that pressure control, we compare the closed loop output signals with respect to the true system Pz,C1z,C2z and the estimated system P^z,C^1z,C2z, respectively. If these two closed loop output signals are the same or their error is tolerable, then we can regard that the estimated system converges to its true system, i.e., P^z⟶Pz,C^1z⟶C1z. Figure 8 shows these two output signals. The red curve is the true closed loop output signals, and the black dots correspond to the estimated closed loop output signals. From Figure 8, we see they correspond to each other, expect for the higher and lower part. Within the interval [8,16], the true outputs coincide with the estimated outputs.Figure 8
Comparisons of the outputs for the brake-by-wire system.


## 7. Conclusion

In this paper, data-driven control is proposed to design two controllers, existing in one closed loop system simultaneously. Firstly, we parametrize controllers by two parameter vectors and then apply the iterative idea to identify them. Secondly, for more general controllers, the iterative idea is also introduced to identify the unknown plant and design controllers. Thirdly, the output-input sensitivity functions are defined for three kinds of disturbances; then, our derived results show that some equities do not vary with the change of the plant. Stability analysis based on the output-input sensitivity functions is our next work.



---

*Source: 4827900-2021-08-04.xml*