# Quadratic Optimal Regulator Design of a Pneumatic Control Valve

Authors: Mohammad Heidari; Hadi Homaei
Journal: Modelling and Simulation in Engineering
 (2013)

---

## Abstract

Pneumatic control valves are still the most used devices in the process industries, due to their low cost and simplicity. This paper presents a regulator for pneumatic control valves using pole-placement method, optimal control, full-order state observer, and minimum-order state observer and their responses will be compared with each other. Bondgraph method has been used to model the control valve. Simulation results have been made for four models of regulator. The results show that minimum overshoot and settling time are achieved using optimal regulator of pneumatic valve.


---

## Body

## 1. Introduction

Process plants consist of hundreds, or even thousands, of control loops all networked together to produce a product to be offered for sale. Each of these control loops is designed to keep some important process variables such as pressure, flow, level, and temperature. within a required operating range to ensure the quality of the end product. Each of these loops receives and internally creates disturbances that detrimentally affect the process variable, and interaction from other loops in the network provides disturbances that influence the process variable. To reduce the effect of these load disturbances, sensors and transmitters collect information about the process variable and its relationship to some desired set point. A controller then processes this information and decides what must be done to get the process variable back to where it should be after a load disturbance occurs. When all the measuring, comparing, and calculating are done, some type of final control element must implement the strategy selected by the controller. The most common final control element in the process control industries is the control valve. The control valve manipulates a flowing fluid, such as gas, steam, water, or chemical compounds, to compensate for the load disturbance and keep the regulated process variable as close as possible to the desired set point. Control valves adjust the temperature, pressure, flow rate, and so forth by changing the flow rate. Figure1 shows a sliding-stem pneumatic control valve. Pneumatic control valves are still the most used valves in the process industries, due to their low cost and simplicity. Pneumatic valves are used extensively in various industries today. Industry standard has been established that details the vibration, humidity, thermal, salt spray, and temperature extremes that these valves must operate within. This makes the design of valve control systems a very challenging task. Control valves have two major components, valve body housing and the actuation unit. One factor in the quality of the final end product is the improvement of the control loop performance. A critical component in the loop is the final control element, the control valve package. Optimized actuator parameters play a vital role in the dynamic performance of the pneumatic control valve.  Champagne and Boyle  [1] reviewed the pneumatic actuator and positioner parameters that affect the control package performance. This is done through the use of a control valve package computer model to assess the dynamic performance. The attributes of spring return versus double acting actuators are illustrated. The effects of supply pressure, step size, load margin, flow, actuator volume, and design style are investigated through the use of mathematical simulations of pneumatic control valve dynamic performance. Hagglund presented a procedure that compensates for static friction (stiction) in pneumatic control valves [2]. The compensation is obtained by adding pulses to the control signal. The characteristics of the pulses are determined from the control action.Figure 1
Pneumatic control valve with diaphragm.The compensator is implemented in industrial controllers and control systems, and the industrial experiences show that the procedure reduces the control error during stick-slip motion significantly compared to standard control without stiction compensation. The oscillations caused by static friction (stiction) in pneumatic control valves cause losses in quality and expense of raw materials. The input-output behavior of a pneumatic control valve affected by stiction in valve.  De Souza et al.  [3] presented a well-known stiction compensation method that reduces variability both at process variable and pneumatic valve stem movement. The two-move method is revisited in this paper and it was shown that assumptions on the knowledge of steady-state stem position of control valve that assures equality of set point and the controlled variable were not easily achievable. Bondgraph is a graphical representation of a physical dynamics system. It is similar to the better known block diagram and signal flow, with the major difference that the arcs in bondgraphs represent bidirectional exchange of physical energy, while those in block diagrams and signal-flow graphs represent unidirectional flow of information. Also, bondgraphs are multidomain and domain neutral. This means that a bondgraph can incorporate multiple domains simultaneously. Bondgraphs were devised by Paynter [4] at MIT in April 1959 and subsequently developed into a methodology together with  Karnopp et al.  [5]. Early prominent promoters of bondgraph modeling techniques among others were Thoma [6], Dixhoorn, and Dransfield. Athanasatos and Costopoulos [7] used the bondgraph method for finding the proactive fault in 4/3 way direction control valve of a high pressure hydraulic system. The accuracy of the bondgraph model was verified by comparing its response to the response of an actual hydraulic system.  Díaz-Zuccarini et al.  [8] utilized the bondgraph as boundary condition for a detailed model of an idealized mitral valve. A specific application in cardiovascular modeling was demonstrated by focusing on a specific example: a 3D model of the mitral valve coupled to a lumped parameter model of the left ventricle.In this study a pneumatic control valve is modeled by bondgraph method. A regulator has been designed using pole-placement method, optimum regulator, full-order state observer, and minimum-order state observer for this system. In continuing, their responses have been compared with each other.This research is organized as follows. Section2 recalls the bondgraph model of valve and proposes equations of motion of valve. Section 3 develops quadratic optimal regulator of pneumatic valve. Sections 4 and 5 present designing a regulator by pole-placement technique; full and minimum order observers, respectively. Section 6 shows the results of full and minimum order regulator observers and quadratic optimal regulator of valve and finally some conclusions are given in Section 7.


## 2. Bondgraph Model of Valve and Transfer Function

The bondgraph model of the valve is shown in Figure2. In this model, SE is the inlet pressure of the system. The pressure changes to force by multiplying in effect area of the diaphragm. In bondgraph, this transformer is modeled by T.F. Element R is the friction of the system. Element I is the movable mass of valve and diaphragm.Figure 2
Bondgraph control valve actuator.ElementC represents the spring of the valve actuator. Also 1-junction is a common flow junction. 1-junctions have equality of flows and the efforts sum up to zero with the same power orientation. In fact, junctions can connect two or more bonds. The direction of the half arrows (⇀) denotes the direction of power flow given by the product of the effort and flow variables associated with the power bond. The bonds in a bondgraph may be numbered sequentially using integers starting with 1. The two 1-junctions in the bondgraph shown can be uniquely identified as (S 1 2) and (S 4 5 6); similarly, symbols like SE1 and R6 can be used to identify a particular element. This system has two state variables P4 and q5·q5 is the displacement of valve stem and the variation of the spring length. Also v4=P4/I4 is the velocity of the valve stem. The equations of motion are derived using bondgraph method as follows:
(1)P˙4=A×SE1-K3q5-R6I4P4,(2)q˙5=P4I4.
Now, if the velocity and position of stem are zero in the initial condition, X(0), then we have
(3)X(0)=[P4(0)q5(0)]=[00].
By derivation of relation (2) with respect to time, we have
(4)q¨5=P˙4I4.
By substitution of P˙4 from (1) into (4), we have
(5)q¨5=A×SE1-K3q5-(R6/I4)P4I4.
By substitution of P4 from (2) into (5), we have
(6)q¨5=1I4(A×SE1-K3q5-R6q˙5).
Using laplace transformation of (6), we have
(7)q5(s)SE1(s)=(A/I4)s2+(R6/I4)s+(K3/I4).
Equation (7) is the transfer function of the valve. The results of bondgargh model of valve show that the response of the system is identical with the result in [9, 10].


## 3. Quadratic Optimal Regulator of Pneumatic Valve

Let us consider the system that is defined as form of a state-space representation as follows:(8)x˙=Ax+Bu,(9)y=Cx+Du,
where x is called the state vector, x˙ the derivative of the state vector with respect to time, y the output vector, and u(t) the input or control vector. Also A is the system matrix, B the input matrix, C the output matrix, and D direct transmission matrix. We will now consider the optimal control problem that, given the system (8), the matrix  K  should be determined, so that
(10)u(t)=-Kx(t).
It means that the control signal is determined by the state of that moment. The dimension of the state feedback gain matrix is 1×n and n is the number of the states. This minimizes the performance index (J) as
(11)J=∫0∞(xTQx+uTRu)dt,
where Q is a positive-definite (or positive semidefinite) Hermitian or real symmetric matrix and R is a positive-definite Hermitian or real symmetric matrix [11].Note that the second term on the right side of (11) accounts for the expenditure of the energy of the signal control. In this problem, we assume that the control vector u(t) is unconstrained. The linear control law given by (11) is the optimal control law. Therefore, if the unknown elements of the matrix K are determined so as to minimize the performance index, then u(t)=-Kx(t) is optimal for any initial state x(0). Hence,
(12)K=R-1BTP.
Equation (12) gives the optimal matrix. Thus the optimal control law to the quadratic optimal control problem where the performance index is given by (11) is linear and given by
(13)u(t)=-Kx(t)=-R-1BTPx(t).
The matrix P in (12) must satisfy the following reduced equation:
(14)ATP+PA-PBR-1BTP+Q=0.
Equation (14) is called the Riccati reduced-matrix equation.


## 4. Designing a Regulator by Pole-Placement Technique

Suppose that the system is defined by (8) and the control signal is given by (10). The feed back gain matrix K that forces the eigenvalues of A-BK to be μ1 and μ2 (desired values) can be determined by the following steps. Firstly, the controllability of the system is checked. The controllability matrix is defined as follows:
(15)M=[AAB].
For this system, the rank of the controllability matrix is two. In the next step, the characteristic polynomial of matrix A,
(16)|sI-A|=s2+a1s+a2,
determines the values of a1 and a2. Now the desired closed-loop poles μ1 and μ2 are determined based on the transient response or frequency response requirements, such as speed, damping ratio, and steady state requirements. The desired characteristic equation becomes
(17)(s-μ1)(s-μ2)=s2+α1s+α2.
The values of α1 and α2 are determined from (17). The required state feedback gain matrix K can be determined from (18):
(18)K=[α2-a2α1-a1]T-1,
where
(19)T=MW.
Matrix W is given by
(20)W=[a1110].


## 5. Full- and Minimum-Order State Observer

If not all state variables are available for feedback, unavailable state variables should be estimated by observer. Suppose that observer observes all state variables of the system, regardless of whether some state variables are available for direct measurement. For this situation we must use full-order state observer and observe all state variables. State observers can be designed if and only if the observability condition is satisfied. Necessary and sufficient condition for observability condition is that the dual of the original system must be completely state controllable [9].The complete state observability for this system is that the rank of(21)N=[CTATCT]
is 2 because the system is a two-degree-of-freedom system. Characteristic equation can be obtained from (16). We should determine two groups of desired poles as each one has two poles. The first group relates to system state variables and the other one relates to observer variables. Therefore, state observer gain matrix can be obtained for both situations. We choose two dominant poles based on the transient response requirements and remained poles assignment so enough far from two dominant poles. State observer gain matrix can be determined from (19)–(23). Also matrix W can be obtained by using (16)–(20) after specifying observer desired poles. Subsequently, we have
(22)Ke=(WNT)-1[α2-a2α1-a1]T.
The transfer function of the full-order controller observer is
(23)U(s)-Y(s)=K(sI-A+KeC+BK)-1Ke.
For designing of minimum-order state observer, we should traverse the following stages. By selecting eigenvalues for observer matrix, the characteristic equation is
(24)|s-Abb+KeAab|=s+α^1,
where α^1 is the desired eigenvalue for the minimum-order observer. The minimum observer gain Ke can be determined by choosing the desired eigenvalue for the minimum-order observer and then the procedure developed for the full-order observer with appropriate modifications. We have
(25)A=[AaaAabAbaAbb],B=[BaBb].
The minimum observer gain is defined as follows:
(26)Ke=(W^N^T)-1(α^1-a^1),
where
(27)N^=Aab,W^=a^1.
Note that a^1 is the coefficient in the characteristic equation for the state equation
(28)|s-Abb|=s+a^1.
The transfer function for minimum-order state observer is given by the following formula:
(29)U(s)-Y(s)=-[C~(s-A~)-1B~+D~],
where
(30)A~=A^-F^Kb,B~=B^-F^(Ka+KbKe),C~=-Kb,D~=-(Ka+KbKe),
where
(31)A^=Abb-KeAab,B^=A^Ke+Aba-KeAaa,F^=Bb-KeBa.


## 6. Results and Discussion

Table1 shows the parameters of a sliding-stem pneumatic control valve.Table 1
Valve parameters [9].
Name of variable
Parameter
Value
Effective area of diaphragm
A
0.196 ft2
Spring constant
K
6790
Movable mass
I(M)
0.03 slug
Resistance and friction coefficient
R
1 lb·S/ft
Air pressure
SE
140 lb/ft2By substitution of Table1 into (7), we have
(32)q5(s)SE1(s)=6.53s2+33.33s+226333.3.
Matrices of the state space equations of the valve are as follows:
(33)A=[01-226333.33-33.33],B=[0914.2],C=[10],D=0.
In this section, we consider the design of regulator system with full- and minimum-order observers and then quadratic optimal regulator of pneumatic valve. The detail of designing a full and minimum order observer is given in the previous section. Let us design a regulator which achieves a 10% maximum overshoot and settle time less than 0.5 second for output when the initial condition is x(0)=[00.1]T.A 10% overshoot and a settling time of 0.5 second yieldξ=0.591 and ωn=13.53; thus, the characteristic equation for dominant poles is s2+16s+183.1=0, where the dominant poles are located at -8±j10.91 [12]. Hence, choose the desired closed-loop poles at s=μi(i=1,2), where
(34)μ1=-8+j10.91,μ2=-8-j10.91.
In the pole placement method, we must first check the rank of the controllability matrix from (15):
(35)M=[0914.2914.2-30470].
Since the rank of matrix M is 2, arbitrary pole placement is possible. In this case for determining the state feedback gain matrix  K=[k1k2], the characteristic polynomial for the desired system is
(36)|sI-A+BK|=|[s00s]-[01-226333.33-33.33]+[0914.2][k1k2]|=s2+(914.2k2+33.33)s+914.2k1+2.2633e5.
The characteristic polynomial must be equal to
(37)(s+μ1)(s+μ2)=(s+8+j10.91)(s+8-j10.91)=s2+16s+183.1.
By equating the coefficients of the terms of the like powers of  s, we obtain
(38)k1=-247.34,k2=-0.019,
or
(39)K=[-247.34-0.019].
Response to initial condition with pole placement method is shown in Figure 3. Note that the maximum overshoot of valve is about 0.4% for output, and settling time is about 0.5 second. The design is thus acceptable.Response to initial condition.
(a)
(b)The input,u(t)=-kx(t), can be calculated from the previously calculated matrices, k and x. The control input, u(t), which is a force is applied to the valve stem. The larger the control input magnitude, the bigger the energy spent by the actuator in generating the control input, and the higher the cost of control. As shown in Figure 6, the maximum value of input control signal is about 0.9. Observability matrix can be obtained from (21) as
(40)N=[1001].
Since the rank of observability matrix is 2, the given system is completely state observable. Hence, full-order observer is applicable. Assume that the desired eigenvalues for full-order observer are λ1=-116 and λ2=-116. The state feedback gain matrix K for this case is obtained as follows:
(41)K=[-247.3751-0.019].
The full observer gain matrix Ke is calculated as follows:
(42)Ke=[200-219500]T.
The transfer function of the full-order observer controller (Gsf) is obtained as follows:
(43)Gsf(s)=-331800s-52710000s2+1343s+213300.
Figure 4 shows results of the initial response of stem valve with full-order observer controller. Note that the maximum overshoot of valve is about 0.15% for output, and settling time is 0.5 second. The design is thus acceptable. In this case, the maximum value of input control signal is about 0.4.Response to initial condition with full-order observer.
(a)
(b)The minimum order observer is of first order. Assume that the desired eigenvalue for minimum order observer isλ1=-40.The state feedback gain matrixK is obtained as
(44)K=[-247.3751-0.019].
And the minimum observer gain Ke can be obtained as
(45)Ke=6.67.
The transfer function of the minimum-order observer controller (Gsm) is obtained as follows:
(46)Gsm(s)=-248.3s-15500s+62.67.
Figure 5 shows results of the initial response of valve stem with minimum-order observer controller. The initial condition is assumed as x(0)=[00.1]T. Note from Figure 5 that the maximum overshoot of valve is about 0.25% for output, and settling time is about 0.5 second. The design is thus acceptable. In this case, control input, u(t), is shown in Figure 6, and the maximum value is about 0.6.Response of system to initial condition with minimum-order observer.
(a)
(b)Figure 6
The control input,u(t), of the system with three methods.Figure6 shows the comparison of control input signal of the valve with pole placement method (pole), full-order observer (full), and minimum-order observer (mini).We will now consider the optimal control problem of valve. For this purpose we choose by trial and errorR=1 and Q=[0.01000.01]. Solving (14) for P, we have
(47)P=[39.4521e-621e-615e-5].
Substituting P into (12), the optimum gain matrix will be as follows:
(48)K=[00.07].
The initial condition is assumed as x(0)=[00.1]T. The results of the overshoot and settling time to step input for closed loop system are shown in Figure 7. As shown in Figure 7, the overshoot is very small and less than 0.018%. Also the settling time is 0.1 sec.Closed-loop initial response of valve for optimal regulator designed withQ and R=1.
(a)
(b)The input,u(t)=-kx(t), can be calculated from the previously calculated matrices, k and x.  The control input for the value of the optimal regulator gain matrix is shown in Figure 8. Note that the maximum input value is about 0.005.Figure 8
The control inputu(t) of the system (with quadratic optimal).Transient response parameters are given in Table2 for comparing four methods of regulator design with each other. All designing of regulators of the valve are under the same initial condition.Table 2
Settling time, overshoot, and maximum control input of the response to initial condition of the valve.
Method for regulator design
Settling time (sec)
Overshoot (%)
Maximum control input
Pole placement
0.5
0.4
0.9
Full-order observer
0.5
0.15
0.4
Minimum-order observer
0.5
0.25
0.6
Optimal regulator
0.1
0.018
0.005


## 7. Conclusion

The aim of this study was the development of design some regulators to meet transient response specifications of a pneumatic control valve. The mathematical model of system and subsequently state equations were derived using bondgraph method. Regulator has been designed using pole-placement method, optimal control, full-order state observer and minimum-order state observer for this system. Also, their responses and then important transient response parameters were derived and a comparison between the four designed regulators was made. It was observed that responses of the pole-placement technique and minimum-order observer are near to each other. The full order observer regulator has the most high overshoot percentage among the other regulators. The results show that the minimum overshoot and settling time are achieved in quadratic optimal regulator of pneumatic valve.



---

*Source: 862190-2013-12-22.xml*