# Robust LQR-Based Neural-Fuzzy Tracking Control for a Lower Limb Exoskeleton System with Parametric Uncertainties and External Disturbances

Authors: Jyotindra Narayan; Santosha K. Dwivedy
Journal: Applied Bionics and Biomechanics
 (2021)

---

## Abstract

The design of an accurate control scheme for a lower limb exoskeleton system has few challenges due to the uncertain dynamics and the unintended subject’s reflexes during gait rehabilitation. In this work, a robust linear quadratic regulator- (LQR-) based neural-fuzzy (NF) control scheme is proposed to address the effect of payload uncertainties and external disturbances during passive-assist gait training. Initially, the Euler-Lagrange principle-based nonlinear dynamic relations are established for the coupled system. The input-output feedback linearization approach is used to transform the nonlinear relations into a linearized state-space form. The architecture of the adaptive neuro-fuzzy inference system (ANFIS) and used membership function are briefly explained. While varying mass parameters up to 20%, three robust neural-fuzzy datasets are formulated offline with the joint error vector and LQR control input. Thereafter, to deal with external interferences, an error dynamics with a disturbance estimator is presented using an online adaptation of the firing strength matrix. The Lyapunov theory is carried out to ensure the asymptotic stability of the coupled human-exoskeleton system in view of the proposed controller. The gait tracking results for the proposed control scheme (RLQR-NF) are presented and compared with the exponential reaching law-based sliding mode (ERL-SM) controller. Furthermore, to investigate the robustness of the proposed control over LQR control, a comparative performance analysis is presented for two cases of parametric uncertainties and external disturbances. The first case considers the 20% raise in mass values with a trigonometric form of disturbances, and the second case includes the effect of the 30% increment in mass values with a random form of disturbances. The simulation runs have shown the promising gait tracking aspects of the designed controller for passive-assist gait training.


---

## Body

## 1. Introduction

Over the last two decades, an increasing number of neurological disorders such as stroke, spinal cord injury, and Parkinson’s disease have been observed in different age groups. The World Health Organization (WHO) reported “stroke” as one of the principal reasons for nearly 5 million people’s fatality through 2000-2016 and the third pioneering source of debility throughout the world [1]. To address the concerns of motor functionality in the lower body caused by neurological disorders, researchers have developed many robot-based lower limb exoskeleton devices to produce therapeutic effects during walking [2, 3]. In a recent work by Kalita et al. [4], a systematic yet comprehensive review has been carried out on the state-of-the-art developments of such multijoint and single-joint exoskeleton devices for gait rehabilitation, mobility aid, and strength amplification.A well-known treadmill-oriented exoskeleton, LOPES [5], has been developed with a 2D translatable pelvis segment, two active hip joints, and an active knee joint for lower limb rehabilitation. The system was controlled to supervise or follow the subjects using “robot-in-charge” and “subject-in-charge” modes. Bortole et al. [6] designed a 6-DOF lower limb exoskeleton for overground training of stroke subjects with a body height of 1.50-1.95 m and a body mass of 100 kg. Hsieh et al. [7] proposed a soft exoskeleton design for preswing gait training of subjects with weak muscles, where a single actuator with a pulley-slider arrangement is used to drive the lower limb joints. The prototype is developed and clinically investigated with seven subjects. In a study on a parallel mechanism-based lower limb rehabilitation, Rastegarpanah et al. [8] investigated the performance of a 6-DOF robot by executing foot trajectories of 20 healthy subjects. Furthermore, the same prototype was tested for eight poststroke patients while carrying out three exercises, i.e., hip flexion/extension, ankle dorsiflexion/plantarflexion, and marching [9]. Aggogeri et al. [10] presented a modular and reconfigurable mechanism for rehabilitating ankle joints of different subjects. Cestari et al. [11] introduced the ATLAS exoskeleton to assist the children during flexion/extension of the hip, knee, and ankle joints. At the preliminary level, a dummy with body features of a 10-year-old child was used to test the exoskeleton system. Patané et al. [12] proposed a multijoint exoskeleton, WAKE-up, to rehabilitate the knee, ankle, and foot of the pediatric subjects with neurological disorders. The device was tested with four healthy children and three children with cerebral palsy. To amplify human endurance while carrying heavy loads, BLEEX [13] (7-DOF/limb) was developed with intelligent and adaptable robot-based strategies where linear hydraulic actuators were used for the actuation of 4-DOF. Recently, Ji et al. [14] introduced a wearable exoskeleton, SIAT-WEXv2, to support the user’s waist and bones while lifting heavy objects in construction and logistic industries by providing an assistive output of 28 N.To augment the rehabilitation devices’ performance, the appropriate control schemes are designed by the researchers for executing repetitive gait movements. The control architecture required for the exoskeleton systems poses extra complexity over the conventional robotic arm control due to the sophisticated mechanical configuration, complex motion trajectory, and human involvement. The researchers, in the literature, have regarded the predefined gait tracking control as the basis of every control scheme for exoskeleton systems, where the joint movements of the lower limb could be estimated using gait analysis experiments [15, 16, 17]. Although the exoskeleton systems exploit the gait of healthy humans to replicate the same using predefined trajectory control schemes, however, in practice, they are unable to attain the proper gait trajectory because of the parametric uncertainties and external disturbances (PUEDs). Therefore, various robust control strategies have been designed to deal with the limitations of classical trajectory tracking control in lower limb exoskeleton systems [18, 19, 20, 21, 22, 23]. Ajayi et al. [18] proposed a bounded control scheme for the rehabilitation of the knee ankle joint of a user in a sitting position. The stability of the control law and convergence analysis of the gain observer is validated with the Lyapunov theory. The simulation results are presented without and with the effect of the human interaction torque. Yang et al. [19] presented a sliding mode control (SMC) scheme where a second-order command filter-aided backstepping is incorporated to avert the “explosion of complexity.” Moreover, the fuzzy logic is exploited to counter the chattering issues of the control scheme during the estimation of structured and unstructured uncertainties. In another work on robust control, Long et al. [20] presented a hybrid strategy where SMC is augmented with a cerebellar model articulation controller (CMAC) to predict the motion intent of the subject. The optimized sliding surface of the SMC is estimated using the genetic algorithm to improve the effectiveness of the proposed control scheme. Liu et al. [21] introduced an event-triggered SMC for effective tracking of the reference trajectory using a lower limb exoskeleton system with PUEDs. In another work to address the model uncertainties and the unintended subject’s response, Wu et al. [22] proposed an adaptive control scheme for a 3-DOF lower extremity rehabilitation device. Working on the decoupled control strategy, Sun et al. [23] designed a reduced-order adaptive fuzzy approach and implemented it on a two-link exoskeleton system for lower limb rehabilitation.Furthermore, in recent times, robust intelligent control schemes have gain popularity to address the adverse effects of PUEDs with effective approximation features. A neural network (NN) along with a time-delay evaluation-based control scheme is proposed by Zhang et al. [24] to realize the desired gait trajectory for a simulated model of a 10-DOF exoskeleton. The performance of the designed control scheme is investigated by comparing the classical PD control scheme. Narayan and Dwivedy [25] proposed a neuro-fuzzy compensator for PID control to deal with the system’s known and unknown uncertainties during passive gait rehabilitation of a human child. The controller is found to be more robust towards external disturbances over payload uncertainties. Chen et al. [26] proposed a disturbance estimator-based subject-cooperative control for a weight-reinforced active-assist rehabilitation device. They computed the interaction torques using a backpropagation neural network-aided disturbance observer and proved the stability using the Lyapunov theory. In a recent work by Han et al. [27], time-delay estimator-aided computed torque control is designed to deal with PUEDs of a lower limb exoskeleton system. Moreover, an adaptive radial basis function neural network (RBFNN) is utilized to compensate for the time-delay error.On the other hand, few researchers have explored the optimal control, especially the linear quadratic regulator (LQR), to realize the natural gait [28, 29, 30, 31]. The LQR scheme with full-state feedback yields control measures concerning the whole body compared to PD control for every independent joint [28]. In addition to that, the relative prominence of curtailing the tracking error and minimalizing the control torque can be regulated by computing optimal values of time-varying gain based on the design parameters of a single controller. Furthermore, LQR as a linear control scheme might be exploited for nonlinear system dynamics by approximating the linear time-varying form and significantly mitigating the computational complexity involved in several nonlinear controllers. Ajjanaromvat and Parnichkun [29] proposed an iterative online learning-based LQR control scheme for a treadmill-appended exoskeleton to investigate the robustness analysis. Moreover, the proposed control scheme is aided with an adaptive iterative learning control to address tracking errors. Gupta et al. [30] presented the LQR control for lower limb exoskeleton systems by considering the 4-DOF human gait model in the Single Support Phase (SSP). They exploited the nondominated sorting genetic algorithm to find out the optimal weighing matrix. However, the formulation work has not considered the uncertain factors in system dynamics. Castro et al. [31] proposed an integral-aided LQR (LQRi) and unknown input disturbance observer (UIO) to address external interferences of the lower limb exoskeleton system. The results of the proposed control are compared with proportional-derivative control and found to be more effective.Although the hybrid form of sliding mode control can be considered a highly robust control strategy, chattering always affects the performance of exoskeleton systems. On the other hand, the LQR is the most optimal control scheme and lacks to resolve uncertain exoskeleton dynamics. Therefore, in this work, a new robust LQR-based neural-fuzzy control scheme is designed for the lower limb exoskeleton system with parametric uncertainties and external disturbances during passive gait rehabilitation training. The key highlights of the present work are as follows:(i)
The input-output feedback linearization approach is represented to linearize the nonlinear dynamics of the lower limb exoskeleton system(ii)
A robust offline LQR-based neural-fuzzy control scheme is designed to deal with payload uncertainties(iii)
A disturbance estimator is proposed using an online adaptation of firing strength in offline designed LQR-NF architecture(iv)
The simulation results are carried out for the RLQR-NF control scheme and compared with an exponential reaching law-based sliding mode control (ERL-SM) to track the desired gait trajectory during passive therapeutic training(v)
The robustness performance of the proposed control scheme (RLQR-NF) is investigated by varying payload parameters and inducing different forms of external disturbancesThe rest of the paperwork is structured as follows. The mechanical description of the lower limb exoskeleton system and the estimation of control input parameters are presented in Section2. In Section 3, the nonlinear dynamic relation is formulated using the Euler-Lagrange principle, and thereafter, input-output linearization of the nonlinear form is explained. Section 4 presents the concept of ANFIS architecture with the selected membership function. Section 5 describes a detailed design procedure of the proposed control strategy. In Section 6, the Lyapunov theory of stability is presented. The control results are simulated and discussed in Section 7. The complete paperwork is concluded in Section 8.


## 2. Mechanical Configuration of the Lower Limb Exoskeleton System

The main criteria for the mechanical design of a lower limb exoskeleton system are to ensure its strength and stability of the subject’s safety. Moreover, the adaptability of the system with different heights of the subjects augments the feature of cost-effectiveness. Considering the subject’s physiological safety, all possible degrees of freedom should be avoided at the initial phases of rehabilitation training. Invoking the design features, authors have designed a low-cost stand-alone module-aided lower limb exoskeleton system for pediatric rehabilitation in their previous work [32]. The CAD model of the designed exoskeleton system is shown in Figures 1(a) and 1(b). A 3-DOF multilink mechanism for each leg was intended to carry out hip flexion/extension, knee flexion/extension, and ankle dorsiflexion/plantarflexion motions. The placements of the joint actuators were made to avoid any physical interference with the subject’s body. To serve subjects of different heights, a telescopic link joint arrangement was designed around the knee joint of the exoskeleton system. Moreover, a detailed structural analysis of the stand-alone module was carried for maximum loading conditions at the hip joint [32].Figure 1
CAD model of (a) LLES (labels: (1) thigh link, (2) shank link, (3) foot link, (4) hybrid stepper motor, (5) lead screw actuator, (6) stepper motor, (7) timing belt, (8) support module, (9) wheels, and (10) telescopic link joint connector) and (b) LEES with a human dummy [32].
(a)(b)The mechanical configuration of the exoskeleton system is intended for children of 8-12 years of age, 25-40 kg weight, and 115-125 cm height. The possible range of motion (ROM) for three joints of the exoskeleton system in the sagittal plane is as follows: 30°/-12° (hip-f/e), 60°/-10° (knee-f/e), and 13°/-20° (ankle-d/p). To avoid any undesirable actions beyond the ROM, an emergency stop option is provisioned at the software interface during simulation runs. In this work, an eight-year-old male subject’s anthropometric and kinematic parameters (body mass: 30 kg and body height: 1.22 m) are considered input parameters to the control architecture. The breakdown of input parameters for the lower limb exoskeleton and subject is shown in Table1, where the length of the thigh and shank link is kept constant at 0.27 m and 0.30 m, respectively.Table 1
Specifications of the lower limb exoskeleton system and child dummy.
PartMass (kg)Length (m)COM (m)Lower limb exoskeleton systemThigh linkm1e=4.75l1e=0.25‐0.30lc1e=0.12‐0.15Shank linkm2e=1.60l2e=0.30‐0.35lc2e=0.14‐0.17Foot linkm3e=0.85l3e=0.05lc3e=0.02Child (age 8 years, body weight 30 kg, and body height 122 cm)Thighm1h=3.50l1h=0.27lc1h=0.13Shankm2h=2.25l2h=0.30lc2h=0.15Footm3h=0.65l3h=0.04lc3h=0.02Furthermore, an affordable wireless Labview-aided Kinect setup was established to conduct the experimental gait analysis. With necessary approval, the child subject was asked to follow an inclined path over the ground in front of the experimental setup for 1.6-2.0 seconds. The angle estimation algorithm comprehended the information about the lower limb joint angles from the skeleton model in Labview. The angle estimation algorithm exploits the relation between joint triples using vector algebra.The detailed procedure of performing gait analysis, as shown in Figure2(a), is based on the work by Narayan et al. [33]. The skeleton form of the subject during the gait analysis is illustrated in Figure 2(b). The desired lower limb joint angles attained from the experiment are presented in Figure 3(a) and the corresponding trajectory in Figure 3(b). The ROM for the hip, knee, and ankle joints are recorded as 22.16° to -8.98°, 58.26° to 1.21°, and 5.84° to -7.94° for an eight-year-old child, respectively.Figure 2
Gait analysis experiment. (a) Schematic diagram of the detailed procedure. (b) A child subject with the skeleton model during the experiment.
(a)(b)Figure 3
Experimental gait data. (a) Desired joint angular trajectory. (b) Desired gait trajectory.
(a)(b)


## 3. Dynamic Model of the Coupled Human-Exoskeleton System

In this section, the Euler-Lagrange principle is used to formulate the nonlinear dynamics of the coupled human-exoskeleton system. Thereafter, the input-output feedback linearization approach is exploited to linearize the nonlinear behavior of the dynamical system. The transformed linear state-space relation is established for the dynamics of the lower limb exoskeleton system.


### 3.1. Nonlinear Dynamic Formulation

Among various methods for expressing applied joint torques and angular acceleration, the Euler-Lagrange principle is well appreciated by the research communities [34]. Invoking the Euler-Lagrange principle, which employs kinetic and potential energy, the nonlinear representation of the coupled human-exoskeleton dynamics is obtained. A multilink structure of the coupled system with a collaboration effect is shown in Figures 4(a) and 4(b).Figure 4
Coupled human-exoskeleton configuration. (a) A simplified linkage model. (b) Interaction dynamics of the coupled human-exoskeleton system.
(a)(b)A generalized formulation to estimate the joint torques using the LagrangianL is as follows:(1)τ=ddt∂L∂θ̇i−∂L∂θi,(2)L=K−P,where(3)K=∑i=1312miṡiTṡi+12θ̇iTIiθ̇i,(4)P=∑i=13mighci.In the abovementioned relations,θi represents the generalized coordinate of the human-exoskeleton system. The kinetic and potential energy about the i-link is denoted by K and P, respectively. In Equation (3), θ̇i, ṡi, mi, and Ii signify the angular velocity, speed of the center of mass in translational direction, mass, and inertia corresponding to the i-link. The acceleration due to the gravitational effects is referred by g, and the distance between the i-link’s center point forming the gravitational vector and the origin is denoted by hci as illustrated in Equation (4).Referring to Equations (2)–(4) to solve Equation (1), the nonlinear dynamics of the coupled dynamical system can be articulated as follows:(5)τ=Mθθ¨+Cθ,θ̇θ̇+Gθ,where(6)τ=τa+τeh+τhe,Mθ=Meθ+Mhθ,Cθ,θ̇=Ceθ,θ̇+Chθ,θ̇,Gθ=Geθ+Ghθ,(7)Mθ=M11M12M13M21M22M23M31M32M33,Cθ,θ̇=C11C12C13C21C22C23C31C32C33,Gθ=G1G2G3,The matrix form of inertial, Coriolis-centrifugal, and gravity effects of the coupled dynamical system is signified byMθ, Cθ,θ̇, and Gθ, respectively. In Equation (6), Meθ and Mhθ represent the inertial dynamics of the exoskeleton and human leg in the matrix form, respectively. The Coriolis-centrifugal matrix of the exoskeleton and human leg is represented by Ceθ,θ̇, and Chθ,θ̇, respectively. The gravity matrix of the exoskeleton and human leg is referred by Geθ and Ghθ, respectively. τa implies the actuator torque while driving the joint of a human’s lower limb. The collaboration torque is indicated by τeh and τhe for collaboration of exoskeletons with humans and vice versa, respectively.During exoskeleton-human interaction, splints are exploited to keep the exoskeleton link and human leg attached, which induces the collaboration torques (τeh and τhe). However, in passive gait rehabilitation, as considered in the present work, these collaborations are withdrawn by assuming rigid connections and matching joint angles for exoskeletons and humans. As illustrated in Figure 4(b), the interaction dynamics is formulated as below:(8)τeh=−τhe=JTfco=JTkΔx+cΔẋ=kθh−θe+cθ̇h−θ̇e,where fco represents the collaboration force between the exoskeleton and the human, k and c signify the mechanical stiffness and damping factors of the used splints, Δx denotes the Cartesian coordinate disparity between the human leg and the exoskeleton link, and θh−θe refers to the joint angular disparity between the human leg and the exoskeleton link.Furthermore, in the presence of parametric uncertainties and external disturbances, Equation (5) can be rewritten as(9)τˇ=Mˇθθ¨+Cˇθ,θ̇θ̇+Gˇθ,where(10)τˇ=ητ+D,Mˇθ=Mθ+ηMθ,Cˇθ,θ̇=Cθ,θ̇+ηCθ,θ̇,Gˇθ=Gθ+ηGθ,where D denotes the external disturbances applied by the subjects to the system; η is the uncertain scaling factor when considering the same amount of variation in dynamic parameters.After considering joint torques (τ) equivalent to joint actuator torques (τa) in case of passive rehabilitation training, the actuator dynamics can be formulated using Kirchhoff’s law to obtain the control voltage (Uˇm) as follows:(11)Uˇm=τˇRmSm+i̇mLm+Ξeθ̇,where Rm, Sm, i̇m, Lm, and Ξe denote the armature resistance, torque sensitivity, current, armature inductance, and back EMF constant of the DC motor. These parameters are selected from the specification sheet provided by Bholanath Precision Engineering Private Limited [35].To imitate the realistic cases, the actuator saturation should be considered in the design of the control law to avoid the hysteresis cycle and maintain the linearity of the actuator. Moreover, this ensures closed-loop stability by limiting the large control signals. Based on the saturation theory, the control signalUˇm from Equation (11) can be further defined as below:(12)Uˇm=℧mUˇm>℧m,UˇmUˇm≤℧m,−℧mUˇm<−℧m,where ℧∈ℝ3 denotes a vector with positive elements. The upper and lower saturation bound is denoted by ℧m and −℧m, respectively.


### 3.2. Input-Output Feedback Linearization

The main objective of the feedback linearization is to correctly linearize the nonlinear dynamics with suitable modifications in state-space coordinates using an inner loop control [34]. Thereafter, an outer loop control with a new set of coordinates can be formed to establish a linear relationship between the output vector (y) and the input vector (uˇ) and validate the cost functions of the control design. Consider the nonlinear multiple-input and single-output (MISO) dynamic relation with n as the order and p as the total number of inputs as well as outputs, defined in the affine state:(13)ẋt=Ψxt+∑i=1pΠixtUˇmit,yit=Λixt,where x=x1,x2,⋯,xnT∈ℝn denotes the state vector, Uˇmi=Uˇm1,Uˇm2,⋯,UˇmpT∈ℝp signifies the control input vector, and y=y1,y2,⋯,ypT∈ℝp indicates the output vector.Theorem 1.
SupposeΨ:ℝn⇒ℝn signifies a smooth vector field on ℝn and Λ:ℝn⇒ℝn denotes a scalar function. Then, the Lie derivative of Λ to Ψ, referred as LΨΛ, is expressed as follows [36, 37]:(14)LΨΛ=∂Λ∂xΨx=∑i=1p∂Λ∂xiΨx.
Similarly, the Lie derivative ofLΨΛ with respect to Ψ is defined as(15)LΨ2Λ=LΨLΨΛ.
In general,(16)LΨγΛ=LΨLΨγ−1ΛwithLΨ0Λ=Λ,∀γ=1,⋯,p.Theorem 2.
The functionΦ:ℝn⇒ℝn, specified in a region Y⊂ℝn, is termed as diffeomorphism if the function Φ along with the inverse Φ−1 (if it exists) is smooth, i.e., differentiable everywhere [36, 37].
However, as the global diffeomorphism is rare, one should check for local diffeomorphisms, i.e., transformations defined in a limited neighborhood of a specified point [37]. With the concept of diffeomorphism, we transform a nonlinear system into another one by changing the variables in the following form:(17)z=z1,z2,⋯,znT=Φx,where Φx characterizes n variables as(18)Φx=Φ1Φ2⋮Φn=Λ1LΨΛ1⋯LΨr1−1Λ1T⋮ΛpLΨΛp⋯LΨrp−1ΛpT,with x=x1,x2,⋯,xnT.Now, a linear relationship between inputs and outputs is to be established by performing the differentiation of the outputsyi till the input terms appear in the formulation. Considering rj is the smallest integer, yjrj can be evaluated with a complete term of inputs as follows:(19)yjrj=LΨrjΛjx+∑i=1pLΠiLΨrj−1ΛjxUˇmi,i,j=1,2,⋯,p,where LΨiΛj and LΠiΛj signify the ith Lie derivatives of Λjx in the direction of Ψ and Π, respectively. In Equation (19), rj denotes the relative degree for the output yj which provides information about the number of derivatives required to carry out at least one of the inputs in the formulation [37, 38]. The sum of every relative degree from Equation (19) constitutes the total relative degree r which needs to be less than or equal to the system’s order.(20)r=∑j=1nrj≤n.Furthermore, rewriting Equation (19) and expressing the nonlinear control law Uˇm to form the linear relationship between the input and the output as follows, one can get(21)y1r1,⋯,yprpT=δx+σx·Uˇm,(22)uˇ=uˇ1,uˇ2,⋯,uˇpT=y1r1,⋯,yprpT,where(23)δx=LΨr1Λ1x⋮⋮LΨrpΛpx,σx=LΠ1LΨr1−1Λ1xLΠ2LΨr1−1Λ1x⋯LΠpLΨr1−1Λ1xLΠ1LΨr2−1Λ2xLΠ2LΨr2−1Λ2x⋯LΠpLΨr2−1Λ2x⋮⋮⋮LΠ1LΨrp−1ΛpxLΠ2LΨrp−1Λpx⋯LΠpLΨrp−1Λpx.Assumingσx is not singular, the input transferred form, i.e., the nonlinear control law, can be possibly defined as(24)Uˇm=σx−1−δx+uˇ,where uˇ=uˇ1,uˇ2,⋯,uˇpT and Uˇm=Uˇm1,Uˇm2,⋯,UˇmpT.In Equation (24), uˇ denotes the new input vector, Uˇm refers to the decoupling control law, σx signifies an invertible matrix of order p×p, and δx represents a decoupling matrix of the system.Furthermore, the linearizing law from Equation (24) is applied for transforming the nonlinear dynamics of the coupled human-exoskeleton system (Equation (9)) into the linear state-space representation as follows:(25)ż=Aˇz+Bˇuˇ,y=Cz,where Aˇ=A+ΔA, Bˇ=B+ΔB, and uˇ=Δ+1u+d.Aˇ and Bˇ are the state-weight factor matrices with the effect of parametric uncertainties; A, B, and C denote the state-weight factor matrices evaluated with nominal system parameters, i.e., in the absence of parametric uncertainties; Δ is the uncertain scaling factor in the linearized state-space form related to state-weight factor matrices and can be expressed in terms of dynamic parameters of the given system [39]. The input vector uˇ carries the effect of parameter variations and external disturbances. The input vector in the absence of PUEDs is denoted by u. The disturbance applied to the system after feedback linearization is denoted by d, being analogous to D from Equation (9). The linearized dynamics in Equation (25) stands valid with the following assumptions:A1: the Aˇ,Bˇ is in the controllable form.A2: the disturbance d is in the bounded form.In the present work, the state vector and output vector related to the hip, knee, and ankle joints of the coupled dynamical system is consideredz=θHθKθAθ̇Hθ̇Kθ̇AT and y=θHθKθAT, respectively. The input vector with nominal system parameters is defined as u=uHuKuAT. Moreover, the respective state-weight factor matrices (A∈ℝ6×6, B∈ℝ6×3, and C∈ℝ3×6) can be formulated as below. The entries of these matrices are extensively presented in the appendix.(26)A=03×3I3α41α~41α42α~42α43α~43α51α~51−α51′α~51′+α51′′α~51′′α52α~52−α52′α~52′+α52′′α~52′′α53α~53+α53′α~53′−α53′′α~53′′α61α~61−α61′α~61′−α61′′α~61′′α62α~62−α62′α~62′−α62′′α~62′′α63α~63−α63′α~63′−α63′′α~63′′03×36×6,B=03×3β41β~41β42β~42β43β~43β51β~51β52β~52β53β~53β61β~61β62β~62β63β~636×3,C=1000100010000000003×6.


## 3.1. Nonlinear Dynamic Formulation

Among various methods for expressing applied joint torques and angular acceleration, the Euler-Lagrange principle is well appreciated by the research communities [34]. Invoking the Euler-Lagrange principle, which employs kinetic and potential energy, the nonlinear representation of the coupled human-exoskeleton dynamics is obtained. A multilink structure of the coupled system with a collaboration effect is shown in Figures 4(a) and 4(b).Figure 4
Coupled human-exoskeleton configuration. (a) A simplified linkage model. (b) Interaction dynamics of the coupled human-exoskeleton system.
(a)(b)A generalized formulation to estimate the joint torques using the LagrangianL is as follows:(1)τ=ddt∂L∂θ̇i−∂L∂θi,(2)L=K−P,where(3)K=∑i=1312miṡiTṡi+12θ̇iTIiθ̇i,(4)P=∑i=13mighci.In the abovementioned relations,θi represents the generalized coordinate of the human-exoskeleton system. The kinetic and potential energy about the i-link is denoted by K and P, respectively. In Equation (3), θ̇i, ṡi, mi, and Ii signify the angular velocity, speed of the center of mass in translational direction, mass, and inertia corresponding to the i-link. The acceleration due to the gravitational effects is referred by g, and the distance between the i-link’s center point forming the gravitational vector and the origin is denoted by hci as illustrated in Equation (4).Referring to Equations (2)–(4) to solve Equation (1), the nonlinear dynamics of the coupled dynamical system can be articulated as follows:(5)τ=Mθθ¨+Cθ,θ̇θ̇+Gθ,where(6)τ=τa+τeh+τhe,Mθ=Meθ+Mhθ,Cθ,θ̇=Ceθ,θ̇+Chθ,θ̇,Gθ=Geθ+Ghθ,(7)Mθ=M11M12M13M21M22M23M31M32M33,Cθ,θ̇=C11C12C13C21C22C23C31C32C33,Gθ=G1G2G3,The matrix form of inertial, Coriolis-centrifugal, and gravity effects of the coupled dynamical system is signified byMθ, Cθ,θ̇, and Gθ, respectively. In Equation (6), Meθ and Mhθ represent the inertial dynamics of the exoskeleton and human leg in the matrix form, respectively. The Coriolis-centrifugal matrix of the exoskeleton and human leg is represented by Ceθ,θ̇, and Chθ,θ̇, respectively. The gravity matrix of the exoskeleton and human leg is referred by Geθ and Ghθ, respectively. τa implies the actuator torque while driving the joint of a human’s lower limb. The collaboration torque is indicated by τeh and τhe for collaboration of exoskeletons with humans and vice versa, respectively.During exoskeleton-human interaction, splints are exploited to keep the exoskeleton link and human leg attached, which induces the collaboration torques (τeh and τhe). However, in passive gait rehabilitation, as considered in the present work, these collaborations are withdrawn by assuming rigid connections and matching joint angles for exoskeletons and humans. As illustrated in Figure 4(b), the interaction dynamics is formulated as below:(8)τeh=−τhe=JTfco=JTkΔx+cΔẋ=kθh−θe+cθ̇h−θ̇e,where fco represents the collaboration force between the exoskeleton and the human, k and c signify the mechanical stiffness and damping factors of the used splints, Δx denotes the Cartesian coordinate disparity between the human leg and the exoskeleton link, and θh−θe refers to the joint angular disparity between the human leg and the exoskeleton link.Furthermore, in the presence of parametric uncertainties and external disturbances, Equation (5) can be rewritten as(9)τˇ=Mˇθθ¨+Cˇθ,θ̇θ̇+Gˇθ,where(10)τˇ=ητ+D,Mˇθ=Mθ+ηMθ,Cˇθ,θ̇=Cθ,θ̇+ηCθ,θ̇,Gˇθ=Gθ+ηGθ,where D denotes the external disturbances applied by the subjects to the system; η is the uncertain scaling factor when considering the same amount of variation in dynamic parameters.After considering joint torques (τ) equivalent to joint actuator torques (τa) in case of passive rehabilitation training, the actuator dynamics can be formulated using Kirchhoff’s law to obtain the control voltage (Uˇm) as follows:(11)Uˇm=τˇRmSm+i̇mLm+Ξeθ̇,where Rm, Sm, i̇m, Lm, and Ξe denote the armature resistance, torque sensitivity, current, armature inductance, and back EMF constant of the DC motor. These parameters are selected from the specification sheet provided by Bholanath Precision Engineering Private Limited [35].To imitate the realistic cases, the actuator saturation should be considered in the design of the control law to avoid the hysteresis cycle and maintain the linearity of the actuator. Moreover, this ensures closed-loop stability by limiting the large control signals. Based on the saturation theory, the control signalUˇm from Equation (11) can be further defined as below:(12)Uˇm=℧mUˇm>℧m,UˇmUˇm≤℧m,−℧mUˇm<−℧m,where ℧∈ℝ3 denotes a vector with positive elements. The upper and lower saturation bound is denoted by ℧m and −℧m, respectively.


## 3.2. Input-Output Feedback Linearization

The main objective of the feedback linearization is to correctly linearize the nonlinear dynamics with suitable modifications in state-space coordinates using an inner loop control [34]. Thereafter, an outer loop control with a new set of coordinates can be formed to establish a linear relationship between the output vector (y) and the input vector (uˇ) and validate the cost functions of the control design. Consider the nonlinear multiple-input and single-output (MISO) dynamic relation with n as the order and p as the total number of inputs as well as outputs, defined in the affine state:(13)ẋt=Ψxt+∑i=1pΠixtUˇmit,yit=Λixt,where x=x1,x2,⋯,xnT∈ℝn denotes the state vector, Uˇmi=Uˇm1,Uˇm2,⋯,UˇmpT∈ℝp signifies the control input vector, and y=y1,y2,⋯,ypT∈ℝp indicates the output vector.Theorem 1.
SupposeΨ:ℝn⇒ℝn signifies a smooth vector field on ℝn and Λ:ℝn⇒ℝn denotes a scalar function. Then, the Lie derivative of Λ to Ψ, referred as LΨΛ, is expressed as follows [36, 37]:(14)LΨΛ=∂Λ∂xΨx=∑i=1p∂Λ∂xiΨx.
Similarly, the Lie derivative ofLΨΛ with respect to Ψ is defined as(15)LΨ2Λ=LΨLΨΛ.
In general,(16)LΨγΛ=LΨLΨγ−1ΛwithLΨ0Λ=Λ,∀γ=1,⋯,p.Theorem 2.
The functionΦ:ℝn⇒ℝn, specified in a region Y⊂ℝn, is termed as diffeomorphism if the function Φ along with the inverse Φ−1 (if it exists) is smooth, i.e., differentiable everywhere [36, 37].
However, as the global diffeomorphism is rare, one should check for local diffeomorphisms, i.e., transformations defined in a limited neighborhood of a specified point [37]. With the concept of diffeomorphism, we transform a nonlinear system into another one by changing the variables in the following form:(17)z=z1,z2,⋯,znT=Φx,where Φx characterizes n variables as(18)Φx=Φ1Φ2⋮Φn=Λ1LΨΛ1⋯LΨr1−1Λ1T⋮ΛpLΨΛp⋯LΨrp−1ΛpT,with x=x1,x2,⋯,xnT.Now, a linear relationship between inputs and outputs is to be established by performing the differentiation of the outputsyi till the input terms appear in the formulation. Considering rj is the smallest integer, yjrj can be evaluated with a complete term of inputs as follows:(19)yjrj=LΨrjΛjx+∑i=1pLΠiLΨrj−1ΛjxUˇmi,i,j=1,2,⋯,p,where LΨiΛj and LΠiΛj signify the ith Lie derivatives of Λjx in the direction of Ψ and Π, respectively. In Equation (19), rj denotes the relative degree for the output yj which provides information about the number of derivatives required to carry out at least one of the inputs in the formulation [37, 38]. The sum of every relative degree from Equation (19) constitutes the total relative degree r which needs to be less than or equal to the system’s order.(20)r=∑j=1nrj≤n.Furthermore, rewriting Equation (19) and expressing the nonlinear control law Uˇm to form the linear relationship between the input and the output as follows, one can get(21)y1r1,⋯,yprpT=δx+σx·Uˇm,(22)uˇ=uˇ1,uˇ2,⋯,uˇpT=y1r1,⋯,yprpT,where(23)δx=LΨr1Λ1x⋮⋮LΨrpΛpx,σx=LΠ1LΨr1−1Λ1xLΠ2LΨr1−1Λ1x⋯LΠpLΨr1−1Λ1xLΠ1LΨr2−1Λ2xLΠ2LΨr2−1Λ2x⋯LΠpLΨr2−1Λ2x⋮⋮⋮LΠ1LΨrp−1ΛpxLΠ2LΨrp−1Λpx⋯LΠpLΨrp−1Λpx.Assumingσx is not singular, the input transferred form, i.e., the nonlinear control law, can be possibly defined as(24)Uˇm=σx−1−δx+uˇ,where uˇ=uˇ1,uˇ2,⋯,uˇpT and Uˇm=Uˇm1,Uˇm2,⋯,UˇmpT.In Equation (24), uˇ denotes the new input vector, Uˇm refers to the decoupling control law, σx signifies an invertible matrix of order p×p, and δx represents a decoupling matrix of the system.Furthermore, the linearizing law from Equation (24) is applied for transforming the nonlinear dynamics of the coupled human-exoskeleton system (Equation (9)) into the linear state-space representation as follows:(25)ż=Aˇz+Bˇuˇ,y=Cz,where Aˇ=A+ΔA, Bˇ=B+ΔB, and uˇ=Δ+1u+d.Aˇ and Bˇ are the state-weight factor matrices with the effect of parametric uncertainties; A, B, and C denote the state-weight factor matrices evaluated with nominal system parameters, i.e., in the absence of parametric uncertainties; Δ is the uncertain scaling factor in the linearized state-space form related to state-weight factor matrices and can be expressed in terms of dynamic parameters of the given system [39]. The input vector uˇ carries the effect of parameter variations and external disturbances. The input vector in the absence of PUEDs is denoted by u. The disturbance applied to the system after feedback linearization is denoted by d, being analogous to D from Equation (9). The linearized dynamics in Equation (25) stands valid with the following assumptions:A1: the Aˇ,Bˇ is in the controllable form.A2: the disturbance d is in the bounded form.In the present work, the state vector and output vector related to the hip, knee, and ankle joints of the coupled dynamical system is consideredz=θHθKθAθ̇Hθ̇Kθ̇AT and y=θHθKθAT, respectively. The input vector with nominal system parameters is defined as u=uHuKuAT. Moreover, the respective state-weight factor matrices (A∈ℝ6×6, B∈ℝ6×3, and C∈ℝ3×6) can be formulated as below. The entries of these matrices are extensively presented in the appendix.(26)A=03×3I3α41α~41α42α~42α43α~43α51α~51−α51′α~51′+α51′′α~51′′α52α~52−α52′α~52′+α52′′α~52′′α53α~53+α53′α~53′−α53′′α~53′′α61α~61−α61′α~61′−α61′′α~61′′α62α~62−α62′α~62′−α62′′α~62′′α63α~63−α63′α~63′−α63′′α~63′′03×36×6,B=03×3β41β~41β42β~42β43β~43β51β~51β52β~52β53β~53β61β~61β62β~62β63β~636×3,C=1000100010000000003×6.


## 4. Adaptive Neural-Fuzzy Inference System

The adaptive neural-fuzzy inference system (ANFIS), colloquially known as the neural-fuzzy or neuro-fuzzy (NF) system, was proposed by Jang and Sun [40] by augmenting the benefits of adaptive neural networks and fuzzy reasoning. In the NF system, IF-THEN-based fuzzy logic inferences are constructed to form the learning rules with a defined input-output dataset and reproduce the output vector with zero error tolerance. A neural-fuzzy system exploits the fuzzy input variables and input-dependent nonfuzzy output variables given by Takagi and Sugeno [41]. For instance,If theaccelerationoftherobot’send−effector is high, then(27)ft=c×accelerationoftherobot’send−effector2.In Equation (27), high signifies a fuzzy label with the membership function (MF), representing the accelerationoftherobot’send−effector in the rule proposition. The rule subsequent with nonfuzzy behavior is formulated according to the input variable of the premise step, accelerationoftherobot’send−effector.


### 4.1. ANFIS Architecture

A neural-fuzzy system inherently exploits the five layers. The primary network architecture with two input vectorsz:x,y and one output vector fz is considered to show the generalized process of ANFIS. As shown in Figure 5, two kinds of nodes are employed in the architecture: first, a square node for adaptation of the parameters, and second, a circular node that behaves as a fixed node with no parameter. The layer-by-layer development of the ANFIS structure is given below [42, 43].Layer 1.
This layer acts as a conversion function for the crisp value of the input vector into an appropriate MF-based fuzzy language, depicted as follows:(28)Oj1=ΩAjx,Oj1=ΩBjy,where Oj1 represents the jth node output for the first layer. ΩAjx and ΩBjy denote the membership weightage of respective input variables, defined for Aj- and Bj-type MF. In this work, the generalized bell membership function is chosen to replicate a proper probability distribution behavior and expressed as follows:(29)bellz:aj,bj,cj=ΩAjx=ΩBjy=11+z−cj/aj2bj.
In Equation (29), “aj” and “bj” signify the width and shape parameters of the membership function. The value of “bj” is generally positive; however, it can be considered negative in case of inverted shape. “cj” indicates the center position of the membership function. Having an extra parameter compared to Gaussian MF, the generalized bell has the added advantage of tuning the steepness at crossover positions.Layer 2.
This layer evaluates the firing strength for every rule using a product of incoming signals from each circular node. It is designated by notationΠ in the ANFIS architecture. The following expression is used to estimate the firing strength (wj) as follows:(30)Oj2=wj=ΩAjx=ΩBjy,j=1,2.Layer 3.
In this layer, the normalization of the node’s firing strength is carried out by dividing thejth rule firing strength to all rules’ total firing strength. This layer is designated by notation N in the ANFIS architecture. The firing strength (w¯j) is normalized as follows:(31)Oj3=w¯j=wjw1+w2,j=1,2.Layer 4.
This layer, having the square nodes, is used to estimate the rule’s involvement by defuzzification of input variables and produce the respective output as follows:(32)Oj4=w¯j∠j=w¯jpjx+qjy+rj,where w¯j indicates the normalized firing strength and pj, qj, and rj signify the subsequent limits.Layer 5.
This layer, having circular shape nodes with the designation∑, processes the final output using the summation of all incoming signals from the preceding layer. Mathematically, it can be expressed as follows:(33)Oj5=∑jw¯j∠j=∑jwj∠j∑jwj.Figure 5
ANFIS architecture.


## 4.1. ANFIS Architecture

A neural-fuzzy system inherently exploits the five layers. The primary network architecture with two input vectorsz:x,y and one output vector fz is considered to show the generalized process of ANFIS. As shown in Figure 5, two kinds of nodes are employed in the architecture: first, a square node for adaptation of the parameters, and second, a circular node that behaves as a fixed node with no parameter. The layer-by-layer development of the ANFIS structure is given below [42, 43].Layer 1.
This layer acts as a conversion function for the crisp value of the input vector into an appropriate MF-based fuzzy language, depicted as follows:(28)Oj1=ΩAjx,Oj1=ΩBjy,where Oj1 represents the jth node output for the first layer. ΩAjx and ΩBjy denote the membership weightage of respective input variables, defined for Aj- and Bj-type MF. In this work, the generalized bell membership function is chosen to replicate a proper probability distribution behavior and expressed as follows:(29)bellz:aj,bj,cj=ΩAjx=ΩBjy=11+z−cj/aj2bj.
In Equation (29), “aj” and “bj” signify the width and shape parameters of the membership function. The value of “bj” is generally positive; however, it can be considered negative in case of inverted shape. “cj” indicates the center position of the membership function. Having an extra parameter compared to Gaussian MF, the generalized bell has the added advantage of tuning the steepness at crossover positions.Layer 2.
This layer evaluates the firing strength for every rule using a product of incoming signals from each circular node. It is designated by notationΠ in the ANFIS architecture. The following expression is used to estimate the firing strength (wj) as follows:(30)Oj2=wj=ΩAjx=ΩBjy,j=1,2.Layer 3.
In this layer, the normalization of the node’s firing strength is carried out by dividing thejth rule firing strength to all rules’ total firing strength. This layer is designated by notation N in the ANFIS architecture. The firing strength (w¯j) is normalized as follows:(31)Oj3=w¯j=wjw1+w2,j=1,2.Layer 4.
This layer, having the square nodes, is used to estimate the rule’s involvement by defuzzification of input variables and produce the respective output as follows:(32)Oj4=w¯j∠j=w¯jpjx+qjy+rj,where w¯j indicates the normalized firing strength and pj, qj, and rj signify the subsequent limits.Layer 5.
This layer, having circular shape nodes with the designation∑, processes the final output using the summation of all incoming signals from the preceding layer. Mathematically, it can be expressed as follows:(33)Oj5=∑jw¯j∠j=∑jwj∠j∑jwj.Figure 5
ANFIS architecture.


## 5. Robust Design of the LQR-Based Neural-Fuzzy Control

The design procedure of RLQR-NF control is organized into two parts: first, the offline training of a robust LQR-based ANFIS training dataset to deal with parametric uncertainties, and second, the online training of the LQR-based ANFIS architecture using the adaptive law of weights to compensate for the external disturbances. In both parts, the effects of parametric uncertainties and external disturbances are explicitly considered. Thereafter, the stability of the proposed control strategy in the presence of PUEDs is addressed by the Lyapunov theory in the next section.


### 5.1. Offline Training of the RLQR-NF Dataset for Parametric Uncertainties

As shown in Figure6, this subsection is further presented into two stages: first, the formulation of a robust LQR-NF dataset by varying mass parameters, and second, the stepwise layout of offline training of a dataset using ANFIS parameters to design the robust control strategy.Figure 6
Flowchart representation of the stage-wise design procedure.


#### 5.1.1. Stage I: Formulation of the RLQR-NF Training Dataset

The training dataset, having multiple-input and single-output (MISO), is formed by employing the concepts of the LQR control strategy as shown in Equation (25). The LQR cost function is considered a minimization problem while applying the optimality conditions and is expressed as follows [44]:(34)J=12∫0∞zTQz+uˇTRuˇdt,where Q and R denote the user-defined state-weight matrix and control cost matrix, respectively. An appropriate selection of both matrices directly influences the performance characteristics of the controller.The generalized input (uˇ) to the control system is articulated by regulating the error vector (ℯ) as follows:(35)uˇ=Kℯ=Kzdes−z,where zdes and z represent the desired and actual state vectors, respectively. The optimal state gain matrix (K) can be expressed in terms of the control cost matrix (R) and the state-weight factor matrix (Bˇ) as follows:(36)K=R−1BˇTP,where P is the answer for the algebraic form of the Riccati equation expressed in the form of state-weight factor matrices (Aˇ and Bˇ), state-weight matrix (Q), and control cost matrix (R) as given below [44, 45]:(37)PAˇ+AˇTP−PBˇR−1BˇTP+Q=0.It is truly evident from Equation (36) that the state gain matrix (K) is regulated by Aˇ, Bˇ, Q, and R matrices where Aˇ and Bˇ are reliant on the mechanical arrangement and dynamic parameters of the requisite system.Exploiting the controller’s gain (K), a generalized dataset (Sd) with the error vector (ℯ) and respective input (uˇ) to the control system can be created in the following form [44]:(38)Sd=ℯTuˇ.In this work, the datasetSd is expanded into a robust form by evaluating the controller’s gain (Kmt,mc,mhf) for a bounded variation of the coupled thigh mt, calf mc, and heel-foot mhf masses of the human-exoskeleton system. Thereafter, the controller input uˇmt,mc,mhf for the hip, knee, and ankle joints is formulated as follows:(39)uˇmt,mc,mhf=Kmt,mc,mhfℯ,where(40)uˇmt,mc,mhf=uˇHmt,mc,mhfuˇKmt,mc,mhfuˇAmt,mc,mhfT,(41)ℯ=ℯθHℯθKℯθAℯθ̇Hℯθ̇Kℯθ̇AT.In Equation (40), uˇHmt,mc,mhf, uˇKmt,mc,mhf, and uˇAmt,mc,mhf denote the controller output for the hip, knee, and ankle joints of the exoskeleton device, respectively. In Equation (41), ℯθH, ℯθK, and ℯθA signify the hip, knee, and ankle joint angular errors, respectively. ℯθ̇H, ℯθ̇K, and ℯθ̇A represent the respective errors of the hip, knee, and ankle joint angular velocities.The expanded structure of the robust datasetSrd is finally depicted as below:(42)Srd=ℯTuˇmt,mc,mhf,where(43)Srd=S1rdS2rdS3rdT.


#### 5.1.2. Stage II: Stepwise Layout of Offline Training of the RLQR-NF Dataset

The layout and execution of the proposed control strategy for the exoskeleton device are presented in the following steps.Step 1.
The state gain matrix (Kmt,mc,mhf) is evaluated by solving Equations (36) and (37) for a different set of coupled thigh mt, calf mc, and heel-foot mhf masses, as shown in Table 2. The parametric variation is incorporated by increasing the nominal mass values up to 20%, with an increment of 0.3, 0.15, and 0.06 kg for the thigh, calf, and heel-foot. After performing several numerical experiments, the state-weight matrix and control cost matrix are selected as Q=diag400000,4000,8000,800,8000,800 and R=eye3,3.Step 2.
Apply Equation (39) to compute the controller input uˇmt,mc,mhf for the operating range of state variables in the error vector as shown in Table 3. The structure of three robust datasets is formed by exploiting Equations (42) and (43).Step 3.
The training of robust datasets is carried out using the ANFIS approach. The first six columns of every dataset are inherently considered the input set. The last column of every dataset is regarded as the output set. The input set comprises the error vectorℯ, and the output set contains the controller input vector uˇmt,mc,mhf. The three ANFIS architectures are formed, trained, and saved as anfis1.fis, anfis2.fis, and anfis3.fis for three controller inputs. Several simulation runs are performed by varying the number of MF from 1 to 50 and epochs from 1 to 30. Thereafter, the training parameters are selected based on the zero error tolerance between the desired and predicted output vectors. In general, ANFIS utilizes two optimization methods: backpropagation and hybrid, to establish the learning between the input and output vectors. A gradient descent model is employed to evaluate the node error in the backpropagation method. In contrast, a least square algorithm along with the gradient descent model is exploited to regulate the errors in the hybrid method. In this work, the hybrid method is used with all three datasets for training the neural-fuzzy networks. The complete details of training parameters are given in Table 4. After generating training files (anfis1.fis, anfis2.fis, and anfis3.fis) as the desired robust LQR-based neural-fuzzy controller, the respective signals are inputted to the nonlinear dynamics of the coupled human-exoskeleton system.Table 2
Variation in lower limb mass parameters of the coupled human-exoskeleton system.
Thigh,mt (kg)Calf,mc (kg)Heel-foot,mhf (kg)8.253.851.508.584.001.568.914.161.629.244.311.689.574.471.749.904.621.80Table 3
Operating range of the error in state variables.
Variables in the error vectorMinimum valueMaximum valueUnitsℯθH-6060DegreeℯθK-6060DegreeℯθA-3030Degreeℯθ̇H-9090Degree/secℯθ̇K-9090Degree/secℯθ̇A-6060Degree/secTable 4
Training parameters of ANFIS architectures.
Training parametersanfis1.fisanfis2.fisanfis3.fisMF typeGaussianGaussianGaussianMF number5123Error tolerance0.000010.00010.001Epochs10155Learning modelHybridHybridHybrid


### 5.2. Online Training of the RLQR-NF Dataset for External Disturbances

Considering assumption A1, the control input with uncertain parametersu^ can be further expressed in terms of the state feedback Kz and disturbance observer d^ as(44)u^=Δ+1u=d^−Kz,where d^ denotes the estimated disturbance by ANFIS architecture, and K signifies the state feedback matrix.Substituting Equation (44) into Equation (22), the linearized dynamic model can be written as(45)ż=Aˇ−BˇKz+Bˇd^+d.Now, the error dynamics of the control design in the time domain can be expressed as below:(46)ℯ̇t=Aˇ−BˇKℯt+Bˇd^t−ft,where(47)Bˇft=żdest−Bˇdt−Aˇ−BˇKzdest.Employing assumption A2, theft can be considered a function with an upper limit. Therefore, the effectiveness of the coupled human-exoskeleton system can be augmented by estimating the ft from d^t. Using the ANFIS architecture mentioned in Section 4, the ft is approximated as follows [46, 47]:(48)fz=W¯TΩz+ϱ¯z,where W¯ denotes the ideal normalized firing strength matrix; Ωz signifies the membership function vector; and ϱ¯z represents an error of approximation with the condition ϱ¯z≤ζ, where ζ is a constant factor.Now utilizing Equations (46) and (48), the error dynamics can be rewritten as(49)ℯ̇t=Aˇ−BˇKℯt+Bˇd^t−W¯TΩz−ϱ¯z.From the above equation, the disturbance estimatord^t is defined as follows to design the control law [47]:(50)d^i=W^jiTΩjz−ζsignℯTPBˇi,i=1,2,⋯,pandj=1,2,⋯,l,where p and l denote the number of inputs and network nodes in the hidden layer.In the above expression, the estimated strength matrixW^ji is updated according to the following law:(51)W^̇ji=−ΓiΩjzℯTPBˇi,where Γi denotes a positive definite matrix with the symmetric property.


## 5.1. Offline Training of the RLQR-NF Dataset for Parametric Uncertainties

As shown in Figure6, this subsection is further presented into two stages: first, the formulation of a robust LQR-NF dataset by varying mass parameters, and second, the stepwise layout of offline training of a dataset using ANFIS parameters to design the robust control strategy.Figure 6
Flowchart representation of the stage-wise design procedure.


### 5.1.1. Stage I: Formulation of the RLQR-NF Training Dataset

The training dataset, having multiple-input and single-output (MISO), is formed by employing the concepts of the LQR control strategy as shown in Equation (25). The LQR cost function is considered a minimization problem while applying the optimality conditions and is expressed as follows [44]:(34)J=12∫0∞zTQz+uˇTRuˇdt,where Q and R denote the user-defined state-weight matrix and control cost matrix, respectively. An appropriate selection of both matrices directly influences the performance characteristics of the controller.The generalized input (uˇ) to the control system is articulated by regulating the error vector (ℯ) as follows:(35)uˇ=Kℯ=Kzdes−z,where zdes and z represent the desired and actual state vectors, respectively. The optimal state gain matrix (K) can be expressed in terms of the control cost matrix (R) and the state-weight factor matrix (Bˇ) as follows:(36)K=R−1BˇTP,where P is the answer for the algebraic form of the Riccati equation expressed in the form of state-weight factor matrices (Aˇ and Bˇ), state-weight matrix (Q), and control cost matrix (R) as given below [44, 45]:(37)PAˇ+AˇTP−PBˇR−1BˇTP+Q=0.It is truly evident from Equation (36) that the state gain matrix (K) is regulated by Aˇ, Bˇ, Q, and R matrices where Aˇ and Bˇ are reliant on the mechanical arrangement and dynamic parameters of the requisite system.Exploiting the controller’s gain (K), a generalized dataset (Sd) with the error vector (ℯ) and respective input (uˇ) to the control system can be created in the following form [44]:(38)Sd=ℯTuˇ.In this work, the datasetSd is expanded into a robust form by evaluating the controller’s gain (Kmt,mc,mhf) for a bounded variation of the coupled thigh mt, calf mc, and heel-foot mhf masses of the human-exoskeleton system. Thereafter, the controller input uˇmt,mc,mhf for the hip, knee, and ankle joints is formulated as follows:(39)uˇmt,mc,mhf=Kmt,mc,mhfℯ,where(40)uˇmt,mc,mhf=uˇHmt,mc,mhfuˇKmt,mc,mhfuˇAmt,mc,mhfT,(41)ℯ=ℯθHℯθKℯθAℯθ̇Hℯθ̇Kℯθ̇AT.In Equation (40), uˇHmt,mc,mhf, uˇKmt,mc,mhf, and uˇAmt,mc,mhf denote the controller output for the hip, knee, and ankle joints of the exoskeleton device, respectively. In Equation (41), ℯθH, ℯθK, and ℯθA signify the hip, knee, and ankle joint angular errors, respectively. ℯθ̇H, ℯθ̇K, and ℯθ̇A represent the respective errors of the hip, knee, and ankle joint angular velocities.The expanded structure of the robust datasetSrd is finally depicted as below:(42)Srd=ℯTuˇmt,mc,mhf,where(43)Srd=S1rdS2rdS3rdT.


### 5.1.2. Stage II: Stepwise Layout of Offline Training of the RLQR-NF Dataset

The layout and execution of the proposed control strategy for the exoskeleton device are presented in the following steps.Step 1.
The state gain matrix (Kmt,mc,mhf) is evaluated by solving Equations (36) and (37) for a different set of coupled thigh mt, calf mc, and heel-foot mhf masses, as shown in Table 2. The parametric variation is incorporated by increasing the nominal mass values up to 20%, with an increment of 0.3, 0.15, and 0.06 kg for the thigh, calf, and heel-foot. After performing several numerical experiments, the state-weight matrix and control cost matrix are selected as Q=diag400000,4000,8000,800,8000,800 and R=eye3,3.Step 2.
Apply Equation (39) to compute the controller input uˇmt,mc,mhf for the operating range of state variables in the error vector as shown in Table 3. The structure of three robust datasets is formed by exploiting Equations (42) and (43).Step 3.
The training of robust datasets is carried out using the ANFIS approach. The first six columns of every dataset are inherently considered the input set. The last column of every dataset is regarded as the output set. The input set comprises the error vectorℯ, and the output set contains the controller input vector uˇmt,mc,mhf. The three ANFIS architectures are formed, trained, and saved as anfis1.fis, anfis2.fis, and anfis3.fis for three controller inputs. Several simulation runs are performed by varying the number of MF from 1 to 50 and epochs from 1 to 30. Thereafter, the training parameters are selected based on the zero error tolerance between the desired and predicted output vectors. In general, ANFIS utilizes two optimization methods: backpropagation and hybrid, to establish the learning between the input and output vectors. A gradient descent model is employed to evaluate the node error in the backpropagation method. In contrast, a least square algorithm along with the gradient descent model is exploited to regulate the errors in the hybrid method. In this work, the hybrid method is used with all three datasets for training the neural-fuzzy networks. The complete details of training parameters are given in Table 4. After generating training files (anfis1.fis, anfis2.fis, and anfis3.fis) as the desired robust LQR-based neural-fuzzy controller, the respective signals are inputted to the nonlinear dynamics of the coupled human-exoskeleton system.Table 2
Variation in lower limb mass parameters of the coupled human-exoskeleton system.
Thigh,mt (kg)Calf,mc (kg)Heel-foot,mhf (kg)8.253.851.508.584.001.568.914.161.629.244.311.689.574.471.749.904.621.80Table 3
Operating range of the error in state variables.
Variables in the error vectorMinimum valueMaximum valueUnitsℯθH-6060DegreeℯθK-6060DegreeℯθA-3030Degreeℯθ̇H-9090Degree/secℯθ̇K-9090Degree/secℯθ̇A-6060Degree/secTable 4
Training parameters of ANFIS architectures.
Training parametersanfis1.fisanfis2.fisanfis3.fisMF typeGaussianGaussianGaussianMF number5123Error tolerance0.000010.00010.001Epochs10155Learning modelHybridHybridHybrid


## 5.1.1. Stage I: Formulation of the RLQR-NF Training Dataset

The training dataset, having multiple-input and single-output (MISO), is formed by employing the concepts of the LQR control strategy as shown in Equation (25). The LQR cost function is considered a minimization problem while applying the optimality conditions and is expressed as follows [44]:(34)J=12∫0∞zTQz+uˇTRuˇdt,where Q and R denote the user-defined state-weight matrix and control cost matrix, respectively. An appropriate selection of both matrices directly influences the performance characteristics of the controller.The generalized input (uˇ) to the control system is articulated by regulating the error vector (ℯ) as follows:(35)uˇ=Kℯ=Kzdes−z,where zdes and z represent the desired and actual state vectors, respectively. The optimal state gain matrix (K) can be expressed in terms of the control cost matrix (R) and the state-weight factor matrix (Bˇ) as follows:(36)K=R−1BˇTP,where P is the answer for the algebraic form of the Riccati equation expressed in the form of state-weight factor matrices (Aˇ and Bˇ), state-weight matrix (Q), and control cost matrix (R) as given below [44, 45]:(37)PAˇ+AˇTP−PBˇR−1BˇTP+Q=0.It is truly evident from Equation (36) that the state gain matrix (K) is regulated by Aˇ, Bˇ, Q, and R matrices where Aˇ and Bˇ are reliant on the mechanical arrangement and dynamic parameters of the requisite system.Exploiting the controller’s gain (K), a generalized dataset (Sd) with the error vector (ℯ) and respective input (uˇ) to the control system can be created in the following form [44]:(38)Sd=ℯTuˇ.In this work, the datasetSd is expanded into a robust form by evaluating the controller’s gain (Kmt,mc,mhf) for a bounded variation of the coupled thigh mt, calf mc, and heel-foot mhf masses of the human-exoskeleton system. Thereafter, the controller input uˇmt,mc,mhf for the hip, knee, and ankle joints is formulated as follows:(39)uˇmt,mc,mhf=Kmt,mc,mhfℯ,where(40)uˇmt,mc,mhf=uˇHmt,mc,mhfuˇKmt,mc,mhfuˇAmt,mc,mhfT,(41)ℯ=ℯθHℯθKℯθAℯθ̇Hℯθ̇Kℯθ̇AT.In Equation (40), uˇHmt,mc,mhf, uˇKmt,mc,mhf, and uˇAmt,mc,mhf denote the controller output for the hip, knee, and ankle joints of the exoskeleton device, respectively. In Equation (41), ℯθH, ℯθK, and ℯθA signify the hip, knee, and ankle joint angular errors, respectively. ℯθ̇H, ℯθ̇K, and ℯθ̇A represent the respective errors of the hip, knee, and ankle joint angular velocities.The expanded structure of the robust datasetSrd is finally depicted as below:(42)Srd=ℯTuˇmt,mc,mhf,where(43)Srd=S1rdS2rdS3rdT.


## 5.1.2. Stage II: Stepwise Layout of Offline Training of the RLQR-NF Dataset

The layout and execution of the proposed control strategy for the exoskeleton device are presented in the following steps.Step 1.
The state gain matrix (Kmt,mc,mhf) is evaluated by solving Equations (36) and (37) for a different set of coupled thigh mt, calf mc, and heel-foot mhf masses, as shown in Table 2. The parametric variation is incorporated by increasing the nominal mass values up to 20%, with an increment of 0.3, 0.15, and 0.06 kg for the thigh, calf, and heel-foot. After performing several numerical experiments, the state-weight matrix and control cost matrix are selected as Q=diag400000,4000,8000,800,8000,800 and R=eye3,3.Step 2.
Apply Equation (39) to compute the controller input uˇmt,mc,mhf for the operating range of state variables in the error vector as shown in Table 3. The structure of three robust datasets is formed by exploiting Equations (42) and (43).Step 3.
The training of robust datasets is carried out using the ANFIS approach. The first six columns of every dataset are inherently considered the input set. The last column of every dataset is regarded as the output set. The input set comprises the error vectorℯ, and the output set contains the controller input vector uˇmt,mc,mhf. The three ANFIS architectures are formed, trained, and saved as anfis1.fis, anfis2.fis, and anfis3.fis for three controller inputs. Several simulation runs are performed by varying the number of MF from 1 to 50 and epochs from 1 to 30. Thereafter, the training parameters are selected based on the zero error tolerance between the desired and predicted output vectors. In general, ANFIS utilizes two optimization methods: backpropagation and hybrid, to establish the learning between the input and output vectors. A gradient descent model is employed to evaluate the node error in the backpropagation method. In contrast, a least square algorithm along with the gradient descent model is exploited to regulate the errors in the hybrid method. In this work, the hybrid method is used with all three datasets for training the neural-fuzzy networks. The complete details of training parameters are given in Table 4. After generating training files (anfis1.fis, anfis2.fis, and anfis3.fis) as the desired robust LQR-based neural-fuzzy controller, the respective signals are inputted to the nonlinear dynamics of the coupled human-exoskeleton system.Table 2
Variation in lower limb mass parameters of the coupled human-exoskeleton system.
Thigh,mt (kg)Calf,mc (kg)Heel-foot,mhf (kg)8.253.851.508.584.001.568.914.161.629.244.311.689.574.471.749.904.621.80Table 3
Operating range of the error in state variables.
Variables in the error vectorMinimum valueMaximum valueUnitsℯθH-6060DegreeℯθK-6060DegreeℯθA-3030Degreeℯθ̇H-9090Degree/secℯθ̇K-9090Degree/secℯθ̇A-6060Degree/secTable 4
Training parameters of ANFIS architectures.
Training parametersanfis1.fisanfis2.fisanfis3.fisMF typeGaussianGaussianGaussianMF number5123Error tolerance0.000010.00010.001Epochs10155Learning modelHybridHybridHybrid


## 5.2. Online Training of the RLQR-NF Dataset for External Disturbances

Considering assumption A1, the control input with uncertain parametersu^ can be further expressed in terms of the state feedback Kz and disturbance observer d^ as(44)u^=Δ+1u=d^−Kz,where d^ denotes the estimated disturbance by ANFIS architecture, and K signifies the state feedback matrix.Substituting Equation (44) into Equation (22), the linearized dynamic model can be written as(45)ż=Aˇ−BˇKz+Bˇd^+d.Now, the error dynamics of the control design in the time domain can be expressed as below:(46)ℯ̇t=Aˇ−BˇKℯt+Bˇd^t−ft,where(47)Bˇft=żdest−Bˇdt−Aˇ−BˇKzdest.Employing assumption A2, theft can be considered a function with an upper limit. Therefore, the effectiveness of the coupled human-exoskeleton system can be augmented by estimating the ft from d^t. Using the ANFIS architecture mentioned in Section 4, the ft is approximated as follows [46, 47]:(48)fz=W¯TΩz+ϱ¯z,where W¯ denotes the ideal normalized firing strength matrix; Ωz signifies the membership function vector; and ϱ¯z represents an error of approximation with the condition ϱ¯z≤ζ, where ζ is a constant factor.Now utilizing Equations (46) and (48), the error dynamics can be rewritten as(49)ℯ̇t=Aˇ−BˇKℯt+Bˇd^t−W¯TΩz−ϱ¯z.From the above equation, the disturbance estimatord^t is defined as follows to design the control law [47]:(50)d^i=W^jiTΩjz−ζsignℯTPBˇi,i=1,2,⋯,pandj=1,2,⋯,l,where p and l denote the number of inputs and network nodes in the hidden layer.In the above expression, the estimated strength matrixW^ji is updated according to the following law:(51)W^̇ji=−ΓiΩjzℯTPBˇi,where Γi denotes a positive definite matrix with the symmetric property.


## 6. Stability Analysis of the LQR-Based Neural-Fuzzy Control

In this section, the Lyapunov function is presented to analyze the global stability of the proposed control scheme under the effect of parametric uncertainties and external disturbances. Consider the Lyapunov candidate function as follows:(52)V=12ℯTPℯ+∑i=1pW~jiTΓi−1W~ji,with(53)W~ji=W^ji−W¯ji,where W~ji denotes the estimation error between the estimated strength matrix and the ideal constant strength matrix.Differentiating Equation (52) and employing Equations (49) and (37), one can obtain(54)V̇=−ℯTQ+KTRKℯ+2ℯTPBˇi×d^i−W¯jiTΩjz−ϱ¯iz+2∑i=1pW~jiTΓi−1W~̇ji.Now utilizing Equation (53), the error difference between the actual value and the desired value by the designed neural-fuzzy network can be expressed as(55)W~jiΩjz=W^jiΩjz−W¯jiΩjz.Moreover, as the firing strength matrixW¯ji is a constant matrix, Equation (53) holds the following relation after differentiation:(56)W~̇ji=W^̇ji.Reconstituting Equation (54) using Equations (55) and (56), one can obtain(57)V̇=−ℯTQ+KTRKℯ+2ℯTPBˇi×d^i−W^jiΩjz+W~jiΩjz−ϱ¯iz+2∑i=1pW~jiTΓi−1W^̇ji,(58)V̇=−ℯTQ+KTRKℯ+2∑i=1pℯTPBˇi×d^i−W^jiΩjz+W~jiΩjz−ϱ¯iz+2∑i=1pW~jiTΓi−1W^̇ji.Now substituting Equations (50) and (51) into Equation (58), one can obtain(59)V̇=−ℯTQ+KTRKℯ+2∑i=1pℯTPBˇi×d^i−W^jiΩjz−ϱ¯iz≤−ℯTQ+KTRKℯ≤0.Invoking the above equation, it can be concluded that the error dynamics of the coupled human-exoskeleton system is asymptotically stable. Therefore, the proposed controller carries out the asymptotic tracking with errorℯ⟶0 (as t⟶∞) following the disturbance estimator (Equation (50)) and firing strength adaptation law (Equation (51)). Furthermore, the local stability of the proposed controller can be analyzed using the pole placement theory, where the convergence rate can be investigated by keeping the poles on the left side of the s-plane [45].


## 7. Results and Discussion

In this section, the simulation results and analyses are presented to evaluate the effectiveness of the proposed control strategy (RLQR-NF) for an exoskeleton device during passive gait rehabilitation measures. The block representation for the proposed control strategy is schematically shown in Figure7. At first, the performance of the proposed control strategy is compared with a contrast control strategy without parametric uncertainties and external disturbances. In this work, the exponential reaching law-based sliding mode (ERL-SM) control is used as a contrast control strategy [48]. Thereafter, two cases are contemplated to demonstrate the controller’s robustness: the first case, increasing the coupled segment masses by 20% with a trigonometric form of disturbances, and the second case, increasing the coupled segment masses by 30% with a random form of disturbances.Figure 7
Schematic representation of the implemented proposed RLQR-NF controller.


### 7.1. Simulation Results without Parametric Uncertainties and External Disturbances

In this subsection, a comparative analysis between the RLQR-NF and ERL-SM control strategies is presented for desired gait tracking during passive gait rehabilitation measures. In the absence of parametric uncertainties and external disturbances, i.e.,Δ=0 and d=0 in Equation (25), the nominal mass values of lower limb segments mt=8.25,mc=3.85,andmhf=1.5 are taken into account for drawing the state of comparison. Using Equation (36), the optimal state gain matrix for the nominal mass parameters K8.25,3.85,1.5 is calculated as below:(60)K8.25,3.85,1.5=448.63−2.72−0.5717.84−0.31−0.1277.6512.402.493.2020.270.828.72−1.9220.170.33−2.566.40.In the ERL-SM control strategy [48], the control law parameters are used as c=diag50,50,50, ε=0.5×I3, and ke=I3. As shown in Figure 8, the healthy gait trajectory is tracked by incorporating the kinematic and dynamic parameters into the proposed control (RLQR-NF) and ERL-SM control strategy. A time period of 2 seconds is considered to complete one gait cycle. The starting Cartesian position (X, Y: 0.25 m, -0.60 m) of the desired gait trajectory is illustrated in black color. The actual trajectories in the Cartesian coordinate frame are presented by the dashed blue line (RLQR-NF) and the green line (ERL-SM).Figure 8
Desired trajectory tracking for ERL-SM and RLQR-NF control schemes with nominal mass values.Figures9(a) and 9(b) depict the tracking error in both directions, i.e., X- and Y-directions (ℯx and ℯy). The maximum absolute deviation in the X-direction ℯxmax for the ERL-SM and RLQR-NF control schemes is 0.013 m and 0.008 m, respectively. In the Y-direction, the respective deviation ℯymax is observed to be 0.009 m and 0.006 m for the ERL-SM and RLQR-NF control strategies.Figure 9
Position tracking error for ERL-SM and RLQR-NF control schemes with nominal mass values. (a)X-direction. (b) Y-direction.
(a)(b)The tracking of desired joint angles with applied control strategies is illustrated in Figures10(a)–10(c). The angular deviations (ℯθH, ℯθK, and ℯθA) from desired joint trajectories are shown in Figures 11(a)–11(c). Considering the hip joint, it is observed that the maximum absolute deviation ℯθHmax for respective controllers is 0.78° (ERL-SM) and 0.51° (RLQR-NF). In the knee joint, the deviation ℯθKmax is found to be 1.15° and 1.16° for the system with the ERL-SM and RLQR-NF control strategies, respectively. For the ankle joint, the respective deviations ℯθAmax are estimated as 0.81° (ERL-SM) and 0.32° (RLQR-NF).Figure 10
Joint angle tracking for ERL-SM and RLQR-NF control schemes with nominal mass values. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Figure 11
Joint tracking error for ERL-SM and RLQR-NF control schemes with nominal mass values. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Figures12(a)–12(c) demonstrate the generated control signals (uH, uK, and uA) following the desired trajectory through repetitive gait rehabilitation exercises. With the ERL-SM control scheme, the peak values of the hip, knee, and ankle signals are estimated as 32.98 V, 19.88 V, and 1.8 V. On the other hand, with the RLQR-NF control scheme, the respective values of control signals are found to be 30.25 V, 18.1 V, and 1.25 V. It is evident from the results that the proposed control strategy (RLQR-NF) outperforms the contrast control strategy (ERL-SM) to track the desired gait trajectory, however, with a marginal difference. Therefore, to demonstrate the effectiveness of the proposed control when dealing with PUEDs, variations in mass parameters and the form of disturbances are considered further.Figure 12
Control signals for ERL-SM and RLQR-NF control schemes with nominal mass values. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)


### 7.2. Simulation Results for Parametric Variations and External Disturbances

In order to realize the robustness of the proposed control strategy (RLQR-NF), the root mean square error (RMSE) is computed and compared with the ERL-SM control strategy for parametric uncertainties and external disturbances. Moreover, based on RMSE values, the performance index (PI) is calculated to analyze the improvement of the proposed control scheme over the contrast control scheme.(61)RMSE=1N∑a=1Nℯa2,PI=RMSEERL‐SM−RMSERLQR‐NFRMSEERL‐SM×100%,where ℯa:ℯθ represents the error between the desired and actual joint angles, and N is the size of the error vector. RMSEERL‐SM and RMSERLQR‐NF signify the root mean square errors related to ERL-SM and RLQR-NF control strategies.Considering the first case of PUEDs (Case I), where the system masses are increased by 20%mt=9.90,mc=4.62,andmhf=1.80 along with a trigonometric form of disturbances D1=6sin4πt,D2=5sin3πt,andD3=3sin2πt, the joint angular errors (ℯθH, ℯθK, and ℯθA) for the applied control strategies are shown in Figures 13(a)–13(c). For the hip joint, RMSEERL‐SM and RMSERLQR‐NF are estimated as 0.578° and 0.283°, respectively. The respective RMSE values for the knee joint are found to be 0.672° and 0.42°. In ankle joint tracking, the RMSE values for the control strategies are recorded as 0.321° and 0.224°.Figure 13
Joint tracking error for ERL-SM and RLQR-NF control schemes with the first case of PUEDs. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Considering the second case of PUEDs (Case II), where the system masses are increased by 30%mt=10.73,mc=5.00,andmhf=1.95 along with a random form of disturbances D1=5×random1,D2=3×random1,andD3=2×random1, the joint angular errors (ℯθH, ℯθK, and ℯθA) for the proposed and contrast control strategies are shown in Figures 14(a)–14(c). For the hip joint, the values of RMSEERL‐SM and RMSERLQR‐NF are found to be 0.613° and 0.287°, respectively. The respective RMSE values related to the knee joint tracking are obtained as 0.742° and 0.434°. The following RMSE values for the ankle joint are found to be 0.334° and 0.228°.Figure 14
Joint tracking error for ERL-SM and RLQR-NF control schemes with the second case of PUEDs. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Table5 presents the performance index (PI) of the proposed control over the contrast control. The proposed control is promising in desired gait tracking compared to the contrast control, subjected to PUEDs. Moreover, as observed from Table 5, the performance index (PI) is improved by 2.15%, 4.01%, and 1.52% in Case II as compared to Case I. During rehabilitation exercises, this performance investigation allows the lower limb exoskeleton system to carry out repetitive movements with greater accuracy under the presence of PUEDs.Table 5
Comparative performance analysis of the proposed control over the contrast control.
Joint nameRMSE (ERL-SM) (deg)RMSE (RLQR-NF) (deg)PI (%)Case I: with a 20% increment in mass parameters and a trigonometric form of external disturbancesmt=9.90,mc=4.62,andmhf=1.80D1=6×sin4πt,D2=5×sin3πt,andD3=3×sin2πtHip0.5780.28351.04Knee0.6720.42037.50Ankle0.3210.22430.21Case II: with a 30% increment in mass parameters and a random form of external disturbancesmt=10.73,mc=5.00,andmhf=1.95D1=6×random4,D2=5×random3,andD3=3×random2Hip0.6130.28753.19Knee0.7420.43441.51Ankle0.3340.22831.73The convergence of both control schemes is investigated by evaluating the settling time, i.e., the time lapsed for the error to drop within 2% of the final value. The settling time for the error in the hip, knee, and ankle joints for every set of mass values is presented in Table6. The low values of settling time indicate the faster convergence of the proposed controller (RLQR-NF) over the contrast controller (ERL-SM) before achieving the full stable state.Table 6
Settling time of ERL-SM and RLQR-NF control schemes for convergence analysis.
Control schemeLower limb jointSettling time (sec)Nominal system massCase I of PUEDsCase II of PUEDsERL-SMHip1.9711.9861.993Knee1.9621.9741.988Ankle1.9271.9431.969RLQR-NFHip1.9511.9671.991Knee1.9461.9591.987Ankle1.9141.9331.958


## 7.1. Simulation Results without Parametric Uncertainties and External Disturbances

In this subsection, a comparative analysis between the RLQR-NF and ERL-SM control strategies is presented for desired gait tracking during passive gait rehabilitation measures. In the absence of parametric uncertainties and external disturbances, i.e.,Δ=0 and d=0 in Equation (25), the nominal mass values of lower limb segments mt=8.25,mc=3.85,andmhf=1.5 are taken into account for drawing the state of comparison. Using Equation (36), the optimal state gain matrix for the nominal mass parameters K8.25,3.85,1.5 is calculated as below:(60)K8.25,3.85,1.5=448.63−2.72−0.5717.84−0.31−0.1277.6512.402.493.2020.270.828.72−1.9220.170.33−2.566.40.In the ERL-SM control strategy [48], the control law parameters are used as c=diag50,50,50, ε=0.5×I3, and ke=I3. As shown in Figure 8, the healthy gait trajectory is tracked by incorporating the kinematic and dynamic parameters into the proposed control (RLQR-NF) and ERL-SM control strategy. A time period of 2 seconds is considered to complete one gait cycle. The starting Cartesian position (X, Y: 0.25 m, -0.60 m) of the desired gait trajectory is illustrated in black color. The actual trajectories in the Cartesian coordinate frame are presented by the dashed blue line (RLQR-NF) and the green line (ERL-SM).Figure 8
Desired trajectory tracking for ERL-SM and RLQR-NF control schemes with nominal mass values.Figures9(a) and 9(b) depict the tracking error in both directions, i.e., X- and Y-directions (ℯx and ℯy). The maximum absolute deviation in the X-direction ℯxmax for the ERL-SM and RLQR-NF control schemes is 0.013 m and 0.008 m, respectively. In the Y-direction, the respective deviation ℯymax is observed to be 0.009 m and 0.006 m for the ERL-SM and RLQR-NF control strategies.Figure 9
Position tracking error for ERL-SM and RLQR-NF control schemes with nominal mass values. (a)X-direction. (b) Y-direction.
(a)(b)The tracking of desired joint angles with applied control strategies is illustrated in Figures10(a)–10(c). The angular deviations (ℯθH, ℯθK, and ℯθA) from desired joint trajectories are shown in Figures 11(a)–11(c). Considering the hip joint, it is observed that the maximum absolute deviation ℯθHmax for respective controllers is 0.78° (ERL-SM) and 0.51° (RLQR-NF). In the knee joint, the deviation ℯθKmax is found to be 1.15° and 1.16° for the system with the ERL-SM and RLQR-NF control strategies, respectively. For the ankle joint, the respective deviations ℯθAmax are estimated as 0.81° (ERL-SM) and 0.32° (RLQR-NF).Figure 10
Joint angle tracking for ERL-SM and RLQR-NF control schemes with nominal mass values. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Figure 11
Joint tracking error for ERL-SM and RLQR-NF control schemes with nominal mass values. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Figures12(a)–12(c) demonstrate the generated control signals (uH, uK, and uA) following the desired trajectory through repetitive gait rehabilitation exercises. With the ERL-SM control scheme, the peak values of the hip, knee, and ankle signals are estimated as 32.98 V, 19.88 V, and 1.8 V. On the other hand, with the RLQR-NF control scheme, the respective values of control signals are found to be 30.25 V, 18.1 V, and 1.25 V. It is evident from the results that the proposed control strategy (RLQR-NF) outperforms the contrast control strategy (ERL-SM) to track the desired gait trajectory, however, with a marginal difference. Therefore, to demonstrate the effectiveness of the proposed control when dealing with PUEDs, variations in mass parameters and the form of disturbances are considered further.Figure 12
Control signals for ERL-SM and RLQR-NF control schemes with nominal mass values. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)


## 7.2. Simulation Results for Parametric Variations and External Disturbances

In order to realize the robustness of the proposed control strategy (RLQR-NF), the root mean square error (RMSE) is computed and compared with the ERL-SM control strategy for parametric uncertainties and external disturbances. Moreover, based on RMSE values, the performance index (PI) is calculated to analyze the improvement of the proposed control scheme over the contrast control scheme.(61)RMSE=1N∑a=1Nℯa2,PI=RMSEERL‐SM−RMSERLQR‐NFRMSEERL‐SM×100%,where ℯa:ℯθ represents the error between the desired and actual joint angles, and N is the size of the error vector. RMSEERL‐SM and RMSERLQR‐NF signify the root mean square errors related to ERL-SM and RLQR-NF control strategies.Considering the first case of PUEDs (Case I), where the system masses are increased by 20%mt=9.90,mc=4.62,andmhf=1.80 along with a trigonometric form of disturbances D1=6sin4πt,D2=5sin3πt,andD3=3sin2πt, the joint angular errors (ℯθH, ℯθK, and ℯθA) for the applied control strategies are shown in Figures 13(a)–13(c). For the hip joint, RMSEERL‐SM and RMSERLQR‐NF are estimated as 0.578° and 0.283°, respectively. The respective RMSE values for the knee joint are found to be 0.672° and 0.42°. In ankle joint tracking, the RMSE values for the control strategies are recorded as 0.321° and 0.224°.Figure 13
Joint tracking error for ERL-SM and RLQR-NF control schemes with the first case of PUEDs. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Considering the second case of PUEDs (Case II), where the system masses are increased by 30%mt=10.73,mc=5.00,andmhf=1.95 along with a random form of disturbances D1=5×random1,D2=3×random1,andD3=2×random1, the joint angular errors (ℯθH, ℯθK, and ℯθA) for the proposed and contrast control strategies are shown in Figures 14(a)–14(c). For the hip joint, the values of RMSEERL‐SM and RMSERLQR‐NF are found to be 0.613° and 0.287°, respectively. The respective RMSE values related to the knee joint tracking are obtained as 0.742° and 0.434°. The following RMSE values for the ankle joint are found to be 0.334° and 0.228°.Figure 14
Joint tracking error for ERL-SM and RLQR-NF control schemes with the second case of PUEDs. (a) Hip joint. (b) Knee joint. (c) Ankle joint.
(a)(b)(c)Table5 presents the performance index (PI) of the proposed control over the contrast control. The proposed control is promising in desired gait tracking compared to the contrast control, subjected to PUEDs. Moreover, as observed from Table 5, the performance index (PI) is improved by 2.15%, 4.01%, and 1.52% in Case II as compared to Case I. During rehabilitation exercises, this performance investigation allows the lower limb exoskeleton system to carry out repetitive movements with greater accuracy under the presence of PUEDs.Table 5
Comparative performance analysis of the proposed control over the contrast control.
Joint nameRMSE (ERL-SM) (deg)RMSE (RLQR-NF) (deg)PI (%)Case I: with a 20% increment in mass parameters and a trigonometric form of external disturbancesmt=9.90,mc=4.62,andmhf=1.80D1=6×sin4πt,D2=5×sin3πt,andD3=3×sin2πtHip0.5780.28351.04Knee0.6720.42037.50Ankle0.3210.22430.21Case II: with a 30% increment in mass parameters and a random form of external disturbancesmt=10.73,mc=5.00,andmhf=1.95D1=6×random4,D2=5×random3,andD3=3×random2Hip0.6130.28753.19Knee0.7420.43441.51Ankle0.3340.22831.73The convergence of both control schemes is investigated by evaluating the settling time, i.e., the time lapsed for the error to drop within 2% of the final value. The settling time for the error in the hip, knee, and ankle joints for every set of mass values is presented in Table6. The low values of settling time indicate the faster convergence of the proposed controller (RLQR-NF) over the contrast controller (ERL-SM) before achieving the full stable state.Table 6
Settling time of ERL-SM and RLQR-NF control schemes for convergence analysis.
Control schemeLower limb jointSettling time (sec)Nominal system massCase I of PUEDsCase II of PUEDsERL-SMHip1.9711.9861.993Knee1.9621.9741.988Ankle1.9271.9431.969RLQR-NFHip1.9511.9671.991Knee1.9461.9591.987Ankle1.9141.9331.958


## 8. Conclusions

In this work, a robust LQR-based neural-fuzzy control has been proposed to follow the natural gait trajectory using an exoskeleton system during passive rehabilitation measures. Primarily, a linearized state-space form of the nonlinear human-exoskeleton has been established via the input-output feedback linearization method. Employing the LQR state gain matrix, robust ANFIS training datasets have been formed with a variation of system parameters. The operating range of the error vector and control responses have been regarded as the training input and output vectors. The ANFIS architectures have been trained offline to deal with the effect of parametric uncertainties. Thereafter, the online adaptation law of firing strength in ANFIS architectures has been incorporated to deal with external disturbances. The asymptotic stability of the coupled dynamics while applying the proposed control has been ensured using the Lyapunov theory. Finally, the effectiveness of the proposed controller has been investigated by comparing it to the exponential reaching law-based sliding mode control. The robustness analysis has been carried out by varying mass parameters and inducing different forms of external disturbances. The simulation results have shown the potential of the proposed robust tracking control for passive gait rehabilitation using an exoskeleton system. In the future, the effect of human involvement will be considered to design an “assist-as-needed” control strategy during active rehabilitation.



---

*Source: 5573041-2021-06-12.xml*