# Motion Intention Analysis-Based Coordinated Control for Amputee-Prosthesis Interaction

Authors: Fei Wang; Shiguang Wen; Chengdong Wu; Yuzhong Zhang; Jincheng Li
Journal: Journal of Robotics
 (2010)

---

## Abstract

To study amputee-prosthesis (AP) interaction, a novel reconfigurable biped robot was designed and fabricated. In homogeneous configuration, two identical artificial legs (ALs) were used to simulate the symmetrical lower limbs of a healthy person. Linear inverted pendulum model combining with ZMP stability criterion was used to generate the gait trajectories of ALs. To acquire interjoint coordination for healthy gait, rate gyroscopes were mounted on CoGs of thigh and shank of both legs. By employing principal component analysis, the measured angular velocities were processed and the motion synergy was obtained in the final. Then, one of two ALs was replaced by a bionic leg (BL), and the biped robot was changed into heterogeneous configuration to simulate the AP coupling system. To realize symmetrical stable walking, master/slave coordinated control strategy is proposed. According to information acquired by gyroscopes, BL recognized the motion intention of AL and reconstructed its kinematic variables based on interjoint coordination. By employing iterative learning control, gait tracking of BL to AL was archived. Real environment robot walking experiments validated the correctness and effectiveness of the proposed scheme.


---

## Body

## 1. Introduction

Lower limb prosthesis is used to compensate the locomotion function for amputees in the field of biomedical rehabilitation. Conventional mechanical prosthesis has been criticized for difficulty in motion transformation, stiff-legged gait and poor mobility under complex condition. Intelligent prosthetic leg controlled by a microprocessing unit can realize the arbitrary gait precisely to coordinate with the sound leg of amputee [1].  It has been a challenging endeavor for interaction between amputee and prosthesis for their different structures, actuation manners, cognitive competence, and dynamic characters. To realize coordinated movement, prosthetic leg must be able to perceive the motion intention of amputee properly so as to actuate its joints accordingly when walking on different terrains with various cadences and stride length.To guarantee the performance of prosthetic leg during development stage, a great amount of repetitive experiments that need amputee to participate entirely is necessary. It is not only costly but also painful to handicapped person, and even leads to accidental injury to amputee. Moreover, individual difference also makes it difficult to obtain the uniform and quantitative performance evaluation for prosthetic leg.To solve problems mentioned above, a novel reconfigurable test-bed for prosthetic leg development is designed and fabricated by the Robotics Group at Northeastern University, China [2], which has two kinds of form called homogeneous configuration and heterogeneous configuration separately. The former is mainly used to study the symmetrical locomotion as many common biped robot systems [3, 4]. The latter, however, provides an ideal platform for the study of multiagent coordination, gait tracking and interaction for AP coupling system.In this research, the heterogeneous configuration of test-bed is used to validate the master/slave dual-leg coordination strategy of the AP coupling system, motion intention recognition, and gait tracking based on iterative learning control. In this architecture, the master is the sound leg of amputee, corresponds to AL in the test-bed.  It generates the active motion that is planned by linear inverted pendulum model combining with ZMP stability criterion. The desired joint angle trajectory is then calculated by inverse kinematics of AL. The slave, however, is prosthetic leg, corresponds to the BL in the test-bed. It perceives the motion intention of the master, and controls itself making gait tracking to realize the coordination to the master.


## 2. Heterogeneous Biped Robot

Figure1 shows the prototype of the test-bed in heterogeneous configuration that is mainly made up of two legs, one is AL used to simulate the sound leg of amputee and another is BL used to simulate stump with prosthetic leg. The two agents are heterogeneous at the aspect of mechanism, actuation manner, sensing capacity, and dynamic characteristics.Figure 1
The test-bed in heterogeneous configuration and 4-bar knee joint mechanism.To realize humanoid gait, both legs are designed and fabricated with 4-bar closed-chain knee joints and flexible prosthetic foot. Joints in AL are actuated by Maxon DC servo-motors, which can realize arbitrary gait. The knee joint of BL are driven by a hybrid actuation system combing magneto-rheological (MR) damper augmented with a DC motor. Hybrid actuation manner greatly improves the mobility and environmental adaptability at the cost of a small rise in energy consumption.


## 3. Dual-Leg Coordination

### 3.1. Overview of Dual-Leg Coordinated Control

Dual-arm and multileg coordination are hot topics in the field of multirobot system research [5–7]. Dual-leg coordination belongs to the stable walking control of biped robot. In the past studies, however, the two legs were usually thought as a bifurcate mechanism of a single biped robot, the gait for the two legs are planned concurrently. Status information and command for both legs can be exchanged directly without the need of perception and the two legs are controlled as a whole by one locomotion controller. The concepts and methods of dual-leg coordination were not explicitly proposed for single biped robot control before.Though quite similar to the dual-arm coordination at the aspect of system task, control principle and implementation method, dual-leg coordination is more difficult due to its complicated constrains. Table1 shows the comparison for the two kinds of coordination.Table 1
Comparison between dual-arm and dual-leg coordination.
ItemsDual-arm coordinationDual-leg coordinationSystem taskGrasping and holding object to track the target trajectorySupporting and moving the HAT of biped robot to realize stable walkingMethodsPlanning, control, and compensation of coordinated motionControlled objectHomogeneous armsHeterogeneous legsTarget objectGrasped and held objectThe HAT (Head, Arms, and Torso)BaseFixedMobileControl complexityRelative simpleComplicatedInterfaceMultiple fingersHip jointsTarget trajectoryTask trajectory of grasped and held objectGait trajectory for the center of HAT or the center of crotchMechanismClosed chain all the timeClosed chain in stance phaseOpen chain in swing phaseConstrainsKinematics and dynamicsDynamic constrains for open chain and both for closed chainMotion patternDifferent for two armsSimilar for two legs (phase-difference)According to control strategy, coordination methods of dual-arm and multileg can be roughly divided into two categories, named master/slave method and object-oriented method separately [8]. The former studies the motion tracking of slave arm (leg) to master arm (leg) by satisfying the constrain conditions of kinematics and dynamics; while the latter studies the tracking of desired motion trajectory and/or force trajectory for task object without considering the details of two arms (legs). For the simplicity of the master/slave method, the coordination capacity and adaptability is limited by the master/slave relations. Object-oriented method accords with the essence of human dual-arm (leg) coordination, however, control algorithm is comparatively complicated. The prosthetic leg has limitations at the aspect of intelligence and maneuverability. Therefore, master/slave strategy is suitable to AP coupling system.According to task, dual-arm coordination can be divided into convey coordination and assemblage coordination. For biped robot, the system task can be described as: the two legs support the HAT, simultaneously, moving it smoothly through coordination to achieve stable walking of the whole biped locomotive system. Therefore, dual-leg coordination can be thought as a special form of convey coordination. Although the differences in terms of mechanism and actuation manner for the two legs, master/slave coordination method can be used in heterogeneous biped robot for the same basic configurations (e.g., length of leg, motion range of joints, etc.) and similar gait pattern for both legs. In dual-leg coordination system, AL is defined as master leg and BL as slave one. A coordination module is usually constructed and used to control the pose and position of interfaces between the HAT and the two legs to satisfy the constrain conditions of kinematics and dynamics. Therefore, motion planning, control, and compensation of the coordination module become key problems in coordinated control system research for AP coupling system.


### 3.2. Coordinated Control Architecture

For the complicated control task, the distributed hierarchical control architecture is used to realize the master/slave coordination for AP coupling system. Hierarchical architecture [9] is an advanced control structure in which the complicated task is decomposed into several levels according to the intelligent grade. For different levels, a certain control strategy and implementation method is used and the complicated task can be accomplished by all levels through interrelation and coordination. By using hierarchical control architecture, fault debugging and system implementation can be easily achieved.According to master/slave relation, two independent hierarchical control systems were built for both legs as shown in Figure2. Either consists of three levels, named task layer, plan layer and drive layer separately.Figure 2
Coordinated control architecture.In the hierarchical control architecture of AL, the task layer has the highest intelligent grade and decides what to do according to environment information or human command. As a master leg, AL decides the task of the whole system, which usually includes level-walking at different speed, walking on stairs and slopes, running, emergency acts, and so forth. Plan layer has the middle intelligent grade and is used to plan the gait to realize the desired task. In plan layer, the kinematics and dynamics equations are solved for gait control purpose, also the planned gait is verified whether satisfying constrain conditions of the coordination model. Drive layer has the lowest intelligent grade, in which DC motors actuate joints to produce planned gait based on Fuzzy-PID feed-back control algorithm.As a slave leg, the task of BL is to track the gait of AL to realize gait synergy. The task layer of BL is used to realize the functions of gait measurement, gait recognition, and gait estimation. In plan layer, a major work is to calculate the desired damper force and motor torque to realize gait tracking. In drive layer, a MR damper augmented by DC motor actuates the knee joint of BL according to the optimized damper force and motor torque obtained in plan layer, and a PD feed-back control algorithm is applied on the MR damper and Fuzzy-PID feed-back control algorithm is applied on the DC motor.


## 3.1. Overview of Dual-Leg Coordinated Control

Dual-arm and multileg coordination are hot topics in the field of multirobot system research [5–7]. Dual-leg coordination belongs to the stable walking control of biped robot. In the past studies, however, the two legs were usually thought as a bifurcate mechanism of a single biped robot, the gait for the two legs are planned concurrently. Status information and command for both legs can be exchanged directly without the need of perception and the two legs are controlled as a whole by one locomotion controller. The concepts and methods of dual-leg coordination were not explicitly proposed for single biped robot control before.Though quite similar to the dual-arm coordination at the aspect of system task, control principle and implementation method, dual-leg coordination is more difficult due to its complicated constrains. Table1 shows the comparison for the two kinds of coordination.Table 1
Comparison between dual-arm and dual-leg coordination.
ItemsDual-arm coordinationDual-leg coordinationSystem taskGrasping and holding object to track the target trajectorySupporting and moving the HAT of biped robot to realize stable walkingMethodsPlanning, control, and compensation of coordinated motionControlled objectHomogeneous armsHeterogeneous legsTarget objectGrasped and held objectThe HAT (Head, Arms, and Torso)BaseFixedMobileControl complexityRelative simpleComplicatedInterfaceMultiple fingersHip jointsTarget trajectoryTask trajectory of grasped and held objectGait trajectory for the center of HAT or the center of crotchMechanismClosed chain all the timeClosed chain in stance phaseOpen chain in swing phaseConstrainsKinematics and dynamicsDynamic constrains for open chain and both for closed chainMotion patternDifferent for two armsSimilar for two legs (phase-difference)According to control strategy, coordination methods of dual-arm and multileg can be roughly divided into two categories, named master/slave method and object-oriented method separately [8]. The former studies the motion tracking of slave arm (leg) to master arm (leg) by satisfying the constrain conditions of kinematics and dynamics; while the latter studies the tracking of desired motion trajectory and/or force trajectory for task object without considering the details of two arms (legs). For the simplicity of the master/slave method, the coordination capacity and adaptability is limited by the master/slave relations. Object-oriented method accords with the essence of human dual-arm (leg) coordination, however, control algorithm is comparatively complicated. The prosthetic leg has limitations at the aspect of intelligence and maneuverability. Therefore, master/slave strategy is suitable to AP coupling system.According to task, dual-arm coordination can be divided into convey coordination and assemblage coordination. For biped robot, the system task can be described as: the two legs support the HAT, simultaneously, moving it smoothly through coordination to achieve stable walking of the whole biped locomotive system. Therefore, dual-leg coordination can be thought as a special form of convey coordination. Although the differences in terms of mechanism and actuation manner for the two legs, master/slave coordination method can be used in heterogeneous biped robot for the same basic configurations (e.g., length of leg, motion range of joints, etc.) and similar gait pattern for both legs. In dual-leg coordination system, AL is defined as master leg and BL as slave one. A coordination module is usually constructed and used to control the pose and position of interfaces between the HAT and the two legs to satisfy the constrain conditions of kinematics and dynamics. Therefore, motion planning, control, and compensation of the coordination module become key problems in coordinated control system research for AP coupling system.


## 3.2. Coordinated Control Architecture

For the complicated control task, the distributed hierarchical control architecture is used to realize the master/slave coordination for AP coupling system. Hierarchical architecture [9] is an advanced control structure in which the complicated task is decomposed into several levels according to the intelligent grade. For different levels, a certain control strategy and implementation method is used and the complicated task can be accomplished by all levels through interrelation and coordination. By using hierarchical control architecture, fault debugging and system implementation can be easily achieved.According to master/slave relation, two independent hierarchical control systems were built for both legs as shown in Figure2. Either consists of three levels, named task layer, plan layer and drive layer separately.Figure 2
Coordinated control architecture.In the hierarchical control architecture of AL, the task layer has the highest intelligent grade and decides what to do according to environment information or human command. As a master leg, AL decides the task of the whole system, which usually includes level-walking at different speed, walking on stairs and slopes, running, emergency acts, and so forth. Plan layer has the middle intelligent grade and is used to plan the gait to realize the desired task. In plan layer, the kinematics and dynamics equations are solved for gait control purpose, also the planned gait is verified whether satisfying constrain conditions of the coordination model. Drive layer has the lowest intelligent grade, in which DC motors actuate joints to produce planned gait based on Fuzzy-PID feed-back control algorithm.As a slave leg, the task of BL is to track the gait of AL to realize gait synergy. The task layer of BL is used to realize the functions of gait measurement, gait recognition, and gait estimation. In plan layer, a major work is to calculate the desired damper force and motor torque to realize gait tracking. In drive layer, a MR damper augmented by DC motor actuates the knee joint of BL according to the optimized damper force and motor torque obtained in plan layer, and a PD feed-back control algorithm is applied on the MR damper and Fuzzy-PID feed-back control algorithm is applied on the DC motor.


## 4. Gait Planning for Artificial Leg

### 4.1. Modeling

Figure3 shows the mass and geometry models of test-bed in homogeneous configuration.Figure 3
Mass and geometry models.It is modeled as a system of 11 material points. Each link has its weight at the position of its CoG. The trunk is counted as the base link. In this research, however, it is assumed that the robot is held in 2D space. The movement of the robot is considered only in sagittal plane. Therefore, it has 6 DOF for gait planning.


#### 4.1.1. Kinematics

First, direct kinematics of AL in swing phase is established in the coordinate system∑XYZ and the matrix of transformation from torso to ankle is expressed in (1).4-bar mechanism in knee joint of AL brought the closed-chain geometrical constrain with kinematics that is expressed in (2), which makes two of the angle variables in θ2a,θ3a,θ4a,andθ5adependent. (1)Aa=[xaa0zaa]=[-l3asinθ3a-l2asinθ2a-l5asinθ5a-l11asin(α-θ2a)-l12asin(β-θ5a)+xha0-l3acosθ3a-l2acosθ2a-l5acosθ5a+l11acos(α-θ2a)+l12acos(β-θ5a)+zha],(2)f1:(l11a-l9a)cos(θ2a-α)+l10acos(θ5a-β)-l3acosθ3a+l4acosθ4a=0,f2:(l11a-l9a)sin(θ2a-α)+l10asin(θ5a-β)-l3asinθ3a+l4asinθ4a=0.


#### 4.1.2. Dynamics

In swing phase, hip joint makes translational movement along a certain trajectory; in the meanwhile thigh and shank make rotational movement. If the generalized coordinateθ=[x1cz1cθ2aθ3aθ4aθ5aθ6a]T that θ4aandθ5a are the dependent variables, then the Lagrange function can be formed as(3)Lswa=∑i=26[12mia(ẋic2+żic2)+12Jiθ̇ia2-miagzic].The drive forces of robot dynamic system areF1x,F1z,T2a,T3a,T4a,T5a,andT6a. According to principle of virtual work, the virtual work of drive force is calculated by(4)δA=F1xδx1c+F1zδz1c+(T2a-T3a-T4a)θ2a+(T3a-T5a)θ3a+(T4a-T5a)θ4a+(T5a-T6a)θ5a+T6aθ6a.Then the generalized force is(5)Q=[F1xF1zT2a-T3a-T4aT3a-T5aT4a-T5aT5a-T6aT6a],
where F1xandF1z are the forces supplied by the HAT;T4aandT5a are the redundancy drive force and are set to 0. Then the Lagrange equation of the first kind is deduced as(6)Mswa(θa)θ̈a+Cswa(θa)θ̇a2+Gswa(θa)=BswaTa+λḟ,
where Mswa is a symmetric matrix called inertial matrix, Cswa is an antisymmetric matrix named centrifugal force or Coriolis force matrix, Gswa is matrix of gravitational forces, B is coefficient matrix of applied torques, and λḟ represents constrain torque.


### 4.2. Gait Planning

#### 4.2.1. ZMP Theory

One of the criterions for estimating the stability of the walking is a ZMP (Zero Moment Point) criterion proposed by Vukobratovic [10]. ZMP is a point on the surface about which the sum of all moments of active forces, momentums are equal to zero. The calculation of ZMP is described as follows (7)xzmp=∑i=1nmi(zï+g)xi-∑i=1nmixïzi+∑i=1nMiy∑i=1nmi(z̈i+g),yzmp=∑i=1nmi(zï+g)yi-∑i=1nmiyïzi+∑i=1nMix∑i=1nmi(z̈i+g),
where mi is the mass, (xi,yi,zi) is the Cartesian coordinate of CoG of ith link, (xzmp,yzmp) is the Cartesian coordinate of ZMP.While a biped robot is standing still or walking very slowly, a projective point of the CoG on the surface is in the polygon made from the contact points on the sole. In the case, the robot is in the statically stable state and keeps on walking without a tumble. However, while the body and/or the legs are moving fast, various accelerations due to motions are produced, and the projective point of the center of gravity is getting out of the polygon. ZMP is like a projective point of the CoG in the standing still state or the slow-walking state of the robot while the robot is in the dynamic-walking state. According to the ZMP criterion, the robot may keep walking without tumbling. In this study, based on the ZMP criterion, the gait planning for AL in the sagittal plane is designed.


#### 4.2.2. Linear Inverted Pendulum Model

Bipedal walking system is complex, nonlinear, and naturally unstable. Linear inverted pendulum model (LIMP) theory provides an alternative approach to generate the gait trajectory of bipedal walking. Figure4 shows the LIMP model and CoG transform model in a sagittal plane.LIMP model and CoG transform model in sagittal plane.
(a)(b)Wheref is the stretching force imposed on the  stick. τ is the moment generated by ground reaction force, θ is the angle of stick inclination (the clockwise direction is positive), M is the concentrated mass representing the HAT, and r is the length of the stick. The mass of the stick is neglected.By using Lagrangian function approach, the dynamics model of LIPM can be deduced by(8)ddt(∂L∂q̇)-∂L∂q=Q,L=T-V=12mr2θ̇2+12mṙ2-mgrcosθ,q=[θr]T,Q=[fτ]T,
where L is Lagrangian function, q is generalized coordinate and Q is the generalized force. Then the dynamics function of LIMP is expressed as(9)mr2θ̈2+2mrṙθ̇+mgrsinθ=τ,mr̈-mrθ̇2+mgcos=f.In order to keep the movement of the CoG in the horizontal direction and get an acceleration motion, the stretching forcef and mass m must satisfy the relation as (10)fcosθ=mg,fsinθ=mẍ.
Solving this equation can get(11)x-p=gzẍ,
where x is the length of the projection of the CoG inx-axis, and z is the height of CoG in z-axis, p is the projection of ZMP in x-axis.


#### 4.2.3. Gait Planning for AL

The gait space features of human walking are shown in Figure5. By set time-spatial features of AL as shown in Table 2, the corresponding ZMP trajectory can be obtained as shown in Figure 6.Table 2
Gait parameters of AL.
ItemValueThigh length0.46 mShank length0.48 mFoot height0.10 mFoot width0.07 mFoot length0.25 mHorizontal distance between ankle joint and heel0.055 mGait velocity95~125 step/minStep length0.20~0.50 mStep width0.10 mStep height0.05~0.10 mStride length0.75~0.83 mGait cycle1.20 sFigure 5
Gait spatial features.Figure 6
Ideal ZMP trajectories.In LIMP, the relation between ZMP and CoG is expressed(12)ẍ=gz(x-xzmp),ÿ=gz(y-yzmp).The trajectories of ZMP was planned as mentioned above, then the trajectories of CoG can be calculated by (12), the ideal trajectories of ZMP and CoG in X and Y axial directions are shown in Figure 7.ZMP and CoG trajectories inX and Y axial directions.
(a)(b)Gait in Cartesian space is intuitive, easy to describe, and good to reflect the relation between robot system and ground. However, the movement of artificial leg is achieved by the rotation of joints. Therefore, the solving of inverse kinematics is needed to map the variables from Cartesian space to joint space. In this research, the Newton-Raphson algorithm is used to calculate the joint angles of AL. Figure8 shows the desired angles of hip joints of both leg, angles of knee and ankle joints of AL separately, which are calculated through inverse kinematics. In general, above-knee amputee always has an intact hip, so that there is only an angular phase difference between hips of sound leg and stump. The ankle of BL is fixed without the need to gait plan. The angle of knee joint in BL should be estimated based on interjoint coordination described in the following section.Desired angles of hip joint, knee joint, and ankle joint.
(a)(b)(c)


## 4.1. Modeling

Figure3 shows the mass and geometry models of test-bed in homogeneous configuration.Figure 3
Mass and geometry models.It is modeled as a system of 11 material points. Each link has its weight at the position of its CoG. The trunk is counted as the base link. In this research, however, it is assumed that the robot is held in 2D space. The movement of the robot is considered only in sagittal plane. Therefore, it has 6 DOF for gait planning.


### 4.1.1. Kinematics

First, direct kinematics of AL in swing phase is established in the coordinate system∑XYZ and the matrix of transformation from torso to ankle is expressed in (1).4-bar mechanism in knee joint of AL brought the closed-chain geometrical constrain with kinematics that is expressed in (2), which makes two of the angle variables in θ2a,θ3a,θ4a,andθ5adependent. (1)Aa=[xaa0zaa]=[-l3asinθ3a-l2asinθ2a-l5asinθ5a-l11asin(α-θ2a)-l12asin(β-θ5a)+xha0-l3acosθ3a-l2acosθ2a-l5acosθ5a+l11acos(α-θ2a)+l12acos(β-θ5a)+zha],(2)f1:(l11a-l9a)cos(θ2a-α)+l10acos(θ5a-β)-l3acosθ3a+l4acosθ4a=0,f2:(l11a-l9a)sin(θ2a-α)+l10asin(θ5a-β)-l3asinθ3a+l4asinθ4a=0.


### 4.1.2. Dynamics

In swing phase, hip joint makes translational movement along a certain trajectory; in the meanwhile thigh and shank make rotational movement. If the generalized coordinateθ=[x1cz1cθ2aθ3aθ4aθ5aθ6a]T that θ4aandθ5a are the dependent variables, then the Lagrange function can be formed as(3)Lswa=∑i=26[12mia(ẋic2+żic2)+12Jiθ̇ia2-miagzic].The drive forces of robot dynamic system areF1x,F1z,T2a,T3a,T4a,T5a,andT6a. According to principle of virtual work, the virtual work of drive force is calculated by(4)δA=F1xδx1c+F1zδz1c+(T2a-T3a-T4a)θ2a+(T3a-T5a)θ3a+(T4a-T5a)θ4a+(T5a-T6a)θ5a+T6aθ6a.Then the generalized force is(5)Q=[F1xF1zT2a-T3a-T4aT3a-T5aT4a-T5aT5a-T6aT6a],
where F1xandF1z are the forces supplied by the HAT;T4aandT5a are the redundancy drive force and are set to 0. Then the Lagrange equation of the first kind is deduced as(6)Mswa(θa)θ̈a+Cswa(θa)θ̇a2+Gswa(θa)=BswaTa+λḟ,
where Mswa is a symmetric matrix called inertial matrix, Cswa is an antisymmetric matrix named centrifugal force or Coriolis force matrix, Gswa is matrix of gravitational forces, B is coefficient matrix of applied torques, and λḟ represents constrain torque.


## 4.1.1. Kinematics

First, direct kinematics of AL in swing phase is established in the coordinate system∑XYZ and the matrix of transformation from torso to ankle is expressed in (1).4-bar mechanism in knee joint of AL brought the closed-chain geometrical constrain with kinematics that is expressed in (2), which makes two of the angle variables in θ2a,θ3a,θ4a,andθ5adependent. (1)Aa=[xaa0zaa]=[-l3asinθ3a-l2asinθ2a-l5asinθ5a-l11asin(α-θ2a)-l12asin(β-θ5a)+xha0-l3acosθ3a-l2acosθ2a-l5acosθ5a+l11acos(α-θ2a)+l12acos(β-θ5a)+zha],(2)f1:(l11a-l9a)cos(θ2a-α)+l10acos(θ5a-β)-l3acosθ3a+l4acosθ4a=0,f2:(l11a-l9a)sin(θ2a-α)+l10asin(θ5a-β)-l3asinθ3a+l4asinθ4a=0.


## 4.1.2. Dynamics

In swing phase, hip joint makes translational movement along a certain trajectory; in the meanwhile thigh and shank make rotational movement. If the generalized coordinateθ=[x1cz1cθ2aθ3aθ4aθ5aθ6a]T that θ4aandθ5a are the dependent variables, then the Lagrange function can be formed as(3)Lswa=∑i=26[12mia(ẋic2+żic2)+12Jiθ̇ia2-miagzic].The drive forces of robot dynamic system areF1x,F1z,T2a,T3a,T4a,T5a,andT6a. According to principle of virtual work, the virtual work of drive force is calculated by(4)δA=F1xδx1c+F1zδz1c+(T2a-T3a-T4a)θ2a+(T3a-T5a)θ3a+(T4a-T5a)θ4a+(T5a-T6a)θ5a+T6aθ6a.Then the generalized force is(5)Q=[F1xF1zT2a-T3a-T4aT3a-T5aT4a-T5aT5a-T6aT6a],
where F1xandF1z are the forces supplied by the HAT;T4aandT5a are the redundancy drive force and are set to 0. Then the Lagrange equation of the first kind is deduced as(6)Mswa(θa)θ̈a+Cswa(θa)θ̇a2+Gswa(θa)=BswaTa+λḟ,
where Mswa is a symmetric matrix called inertial matrix, Cswa is an antisymmetric matrix named centrifugal force or Coriolis force matrix, Gswa is matrix of gravitational forces, B is coefficient matrix of applied torques, and λḟ represents constrain torque.


## 4.2. Gait Planning

### 4.2.1. ZMP Theory

One of the criterions for estimating the stability of the walking is a ZMP (Zero Moment Point) criterion proposed by Vukobratovic [10]. ZMP is a point on the surface about which the sum of all moments of active forces, momentums are equal to zero. The calculation of ZMP is described as follows (7)xzmp=∑i=1nmi(zï+g)xi-∑i=1nmixïzi+∑i=1nMiy∑i=1nmi(z̈i+g),yzmp=∑i=1nmi(zï+g)yi-∑i=1nmiyïzi+∑i=1nMix∑i=1nmi(z̈i+g),
where mi is the mass, (xi,yi,zi) is the Cartesian coordinate of CoG of ith link, (xzmp,yzmp) is the Cartesian coordinate of ZMP.While a biped robot is standing still or walking very slowly, a projective point of the CoG on the surface is in the polygon made from the contact points on the sole. In the case, the robot is in the statically stable state and keeps on walking without a tumble. However, while the body and/or the legs are moving fast, various accelerations due to motions are produced, and the projective point of the center of gravity is getting out of the polygon. ZMP is like a projective point of the CoG in the standing still state or the slow-walking state of the robot while the robot is in the dynamic-walking state. According to the ZMP criterion, the robot may keep walking without tumbling. In this study, based on the ZMP criterion, the gait planning for AL in the sagittal plane is designed.


### 4.2.2. Linear Inverted Pendulum Model

Bipedal walking system is complex, nonlinear, and naturally unstable. Linear inverted pendulum model (LIMP) theory provides an alternative approach to generate the gait trajectory of bipedal walking. Figure4 shows the LIMP model and CoG transform model in a sagittal plane.LIMP model and CoG transform model in sagittal plane.
(a)(b)Wheref is the stretching force imposed on the  stick. τ is the moment generated by ground reaction force, θ is the angle of stick inclination (the clockwise direction is positive), M is the concentrated mass representing the HAT, and r is the length of the stick. The mass of the stick is neglected.By using Lagrangian function approach, the dynamics model of LIPM can be deduced by(8)ddt(∂L∂q̇)-∂L∂q=Q,L=T-V=12mr2θ̇2+12mṙ2-mgrcosθ,q=[θr]T,Q=[fτ]T,
where L is Lagrangian function, q is generalized coordinate and Q is the generalized force. Then the dynamics function of LIMP is expressed as(9)mr2θ̈2+2mrṙθ̇+mgrsinθ=τ,mr̈-mrθ̇2+mgcos=f.In order to keep the movement of the CoG in the horizontal direction and get an acceleration motion, the stretching forcef and mass m must satisfy the relation as (10)fcosθ=mg,fsinθ=mẍ.
Solving this equation can get(11)x-p=gzẍ,
where x is the length of the projection of the CoG inx-axis, and z is the height of CoG in z-axis, p is the projection of ZMP in x-axis.


### 4.2.3. Gait Planning for AL

The gait space features of human walking are shown in Figure5. By set time-spatial features of AL as shown in Table 2, the corresponding ZMP trajectory can be obtained as shown in Figure 6.Table 2
Gait parameters of AL.
ItemValueThigh length0.46 mShank length0.48 mFoot height0.10 mFoot width0.07 mFoot length0.25 mHorizontal distance between ankle joint and heel0.055 mGait velocity95~125 step/minStep length0.20~0.50 mStep width0.10 mStep height0.05~0.10 mStride length0.75~0.83 mGait cycle1.20 sFigure 5
Gait spatial features.Figure 6
Ideal ZMP trajectories.In LIMP, the relation between ZMP and CoG is expressed(12)ẍ=gz(x-xzmp),ÿ=gz(y-yzmp).The trajectories of ZMP was planned as mentioned above, then the trajectories of CoG can be calculated by (12), the ideal trajectories of ZMP and CoG in X and Y axial directions are shown in Figure 7.ZMP and CoG trajectories inX and Y axial directions.
(a)(b)Gait in Cartesian space is intuitive, easy to describe, and good to reflect the relation between robot system and ground. However, the movement of artificial leg is achieved by the rotation of joints. Therefore, the solving of inverse kinematics is needed to map the variables from Cartesian space to joint space. In this research, the Newton-Raphson algorithm is used to calculate the joint angles of AL. Figure8 shows the desired angles of hip joints of both leg, angles of knee and ankle joints of AL separately, which are calculated through inverse kinematics. In general, above-knee amputee always has an intact hip, so that there is only an angular phase difference between hips of sound leg and stump. The ankle of BL is fixed without the need to gait plan. The angle of knee joint in BL should be estimated based on interjoint coordination described in the following section.Desired angles of hip joint, knee joint, and ankle joint.
(a)(b)(c)


## 4.2.1. ZMP Theory

One of the criterions for estimating the stability of the walking is a ZMP (Zero Moment Point) criterion proposed by Vukobratovic [10]. ZMP is a point on the surface about which the sum of all moments of active forces, momentums are equal to zero. The calculation of ZMP is described as follows (7)xzmp=∑i=1nmi(zï+g)xi-∑i=1nmixïzi+∑i=1nMiy∑i=1nmi(z̈i+g),yzmp=∑i=1nmi(zï+g)yi-∑i=1nmiyïzi+∑i=1nMix∑i=1nmi(z̈i+g),
where mi is the mass, (xi,yi,zi) is the Cartesian coordinate of CoG of ith link, (xzmp,yzmp) is the Cartesian coordinate of ZMP.While a biped robot is standing still or walking very slowly, a projective point of the CoG on the surface is in the polygon made from the contact points on the sole. In the case, the robot is in the statically stable state and keeps on walking without a tumble. However, while the body and/or the legs are moving fast, various accelerations due to motions are produced, and the projective point of the center of gravity is getting out of the polygon. ZMP is like a projective point of the CoG in the standing still state or the slow-walking state of the robot while the robot is in the dynamic-walking state. According to the ZMP criterion, the robot may keep walking without tumbling. In this study, based on the ZMP criterion, the gait planning for AL in the sagittal plane is designed.


## 4.2.2. Linear Inverted Pendulum Model

Bipedal walking system is complex, nonlinear, and naturally unstable. Linear inverted pendulum model (LIMP) theory provides an alternative approach to generate the gait trajectory of bipedal walking. Figure4 shows the LIMP model and CoG transform model in a sagittal plane.LIMP model and CoG transform model in sagittal plane.
(a)(b)Wheref is the stretching force imposed on the  stick. τ is the moment generated by ground reaction force, θ is the angle of stick inclination (the clockwise direction is positive), M is the concentrated mass representing the HAT, and r is the length of the stick. The mass of the stick is neglected.By using Lagrangian function approach, the dynamics model of LIPM can be deduced by(8)ddt(∂L∂q̇)-∂L∂q=Q,L=T-V=12mr2θ̇2+12mṙ2-mgrcosθ,q=[θr]T,Q=[fτ]T,
where L is Lagrangian function, q is generalized coordinate and Q is the generalized force. Then the dynamics function of LIMP is expressed as(9)mr2θ̈2+2mrṙθ̇+mgrsinθ=τ,mr̈-mrθ̇2+mgcos=f.In order to keep the movement of the CoG in the horizontal direction and get an acceleration motion, the stretching forcef and mass m must satisfy the relation as (10)fcosθ=mg,fsinθ=mẍ.
Solving this equation can get(11)x-p=gzẍ,
where x is the length of the projection of the CoG inx-axis, and z is the height of CoG in z-axis, p is the projection of ZMP in x-axis.


## 4.2.3. Gait Planning for AL

The gait space features of human walking are shown in Figure5. By set time-spatial features of AL as shown in Table 2, the corresponding ZMP trajectory can be obtained as shown in Figure 6.Table 2
Gait parameters of AL.
ItemValueThigh length0.46 mShank length0.48 mFoot height0.10 mFoot width0.07 mFoot length0.25 mHorizontal distance between ankle joint and heel0.055 mGait velocity95~125 step/minStep length0.20~0.50 mStep width0.10 mStep height0.05~0.10 mStride length0.75~0.83 mGait cycle1.20 sFigure 5
Gait spatial features.Figure 6
Ideal ZMP trajectories.In LIMP, the relation between ZMP and CoG is expressed(12)ẍ=gz(x-xzmp),ÿ=gz(y-yzmp).The trajectories of ZMP was planned as mentioned above, then the trajectories of CoG can be calculated by (12), the ideal trajectories of ZMP and CoG in X and Y axial directions are shown in Figure 7.ZMP and CoG trajectories inX and Y axial directions.
(a)(b)Gait in Cartesian space is intuitive, easy to describe, and good to reflect the relation between robot system and ground. However, the movement of artificial leg is achieved by the rotation of joints. Therefore, the solving of inverse kinematics is needed to map the variables from Cartesian space to joint space. In this research, the Newton-Raphson algorithm is used to calculate the joint angles of AL. Figure8 shows the desired angles of hip joints of both leg, angles of knee and ankle joints of AL separately, which are calculated through inverse kinematics. In general, above-knee amputee always has an intact hip, so that there is only an angular phase difference between hips of sound leg and stump. The ankle of BL is fixed without the need to gait plan. The angle of knee joint in BL should be estimated based on interjoint coordination described in the following section.Desired angles of hip joint, knee joint, and ankle joint.
(a)(b)(c)


## 5. Gait Recognition and Estimation for Bionic Leg

Although amputee and his/her artificial limb (prosthesis) can exchange information directly through electromyography (EMG) or biological neural signal, EMG and neural signal-based prosthesis techniques are still premature. For common prosthesis, movement intention of amputee can only be perceived by its own perception system. In this research, embedded 3-axial attitude sensor can measure kinematic information of the thigh that reflects the amputee’s posture and walking conditions. Based on these measured data, gait pattern of BL can be estimated by tuned gait classifier so that MR damper can drive the knee joint to coordinate with the sound leg of amputee to realize symmetrical stable walking.In recent years, inertial motion capture has emerged as one of the most versatile methods of full-body ambulation measurement. By using sensor fusion of three-axis gyroscopes and three-axis accelerometers, inertial sensors accurately measure the orientation and position of body segments in a global coordinate system in this research. The nature of the sensor technology used allows inertial motion capture systems to overcome some of the most pressing limitations found in alternative methods such as optical, mechanical, acoustic, and magnetic motion capture.


### 5.1. Overview of Principal Component Analysis

Principal component analysis (PCA) is a general approach to compression and dimensionality reduction for mass data based on multivariable statistical analysis. The basic idea of PCA is to attempt to efficiently represent the data by decomposing a data space into a linear combination of a small collection of bases consisting of orthogonals that maximally preserves the variance in the data. Ifn measurements of m-tuple XT=(x1,x2,…,xm) represent original data with linear correlations, then the jthprincipal component (PC) can be expressed as(13)Pj=aj1x1+aj1x2+⋯+ajmxm∑iaji2=1.The coefficientsaji(i=1,2,…,m) are called the factor loadings. The magnitude indicates the amount of variation in variable xi that is captured by the principal component Pjand the sign indicates the nature of correlation between Pjandxi. For a given data set, PCA produces a unique solution. The common procedure of PCA can be summarized as the following 4 steps.(1) Normalization of Original Data
In order to perform PCA, the data need to have zero mean as well as stand deviation of 1 and the normalization can be achieved by(14)xij*=xij-μiσi,μi=∑j=1nxijn,σi=∑j=1n(xij-μj)(n-1),
where i=1,2,…,m;j=1,2,…,n.(2) Calculation of Covariance Matrix R
We have(15)R=1N-1X*TX*,
where X* is the normalized matrix of X.(3) Determination of the Number of PC
The eigenvectors are obtained algebraically through decomposition of the covariance matrixR of the original data. If the eigenvalue λi(i=1,2,...,m) and eigenvector γi(i=1,2,…,m) are given, the number of PC p can be determined by
(16)ηi=λi∑i=1mλi,ϵ(p)=∑i=1pηi,
where psatisfies ϵ(p)≥85%~90%.(4) Determination of Transformation matrix Γ
The transformation matrixΓ formed by the p eigenvectors of matrix R sorted in descending order of the corresponding eigenvalue
(17)Γ=(γ1,γ2,…γp)
which maps X on the new coordinates P with
(18)P=ΓTX.


### 5.2. Reconstruction of BL’s Kinematics Using AL’s Kinematics

In human gait, it has been observed that joint angle trajectories show strong linear correlations [11–13], which indicates that a compressed gait data set can be obtained by using PCA. If the original gait data X is acquired by sensors and preprocessed, the orthogonal unit eigenvector γi(i=1,2,…,m) and transformation matrix R=(γ1,γ2,…,γm) can be obtained and the new gait variables can be expressed as(19)Y=RTX.SinceR is orthogonal matrix, X can be reconstructed from Y by(20)X=RY.Ifp is determined, then the equation can be rewritten as(21)X=ΓY*,
where Γ=(γ1,γ2,…,γp), Y* is the top p rows of Y. Neglecting the last components of Y, the data is reduced in a way that the least information is lost. A reconstruction of X from the lower dimensional coordinate Y*, leads to a least-square optimal fit of the original data. PCA cannot only be used for compression, but also for reconstruction of incomplete measurements.Assuming that the first components ofX1∈ℝ(m-l) of X are known, and the remaining part X2∈ℝ(l) is unknown, (21) is separated into(22)X1=Γ1Y*,X2=Γ2Y*,
where  Γ1∈ℝ(m-l)×p and Γ2∈ℝl×p are the sub matrix of Γ. Thus X2 is reconstructed from X1 by(23)X2=Γ2(Γ1TΓ1)-1Γ1TX1.For AP coupling system, the observable data is the motion of sound leg, and the missing data is the motion of BL. To obtain the covariance matrixR, the test-bed was firstly configured as homogeneous form, CoGs of thigh and shank of two identical ALs were mounted with rate gyroscopes, and walking experiments were conducted with various cadences and stride length. The acquired data from gyroscopes were treated by following the procedures described above and the covariance matrix was obtained in the final. Then the test-bed is reconfigured as heterogeneous form and a pair of rate gyroscope mounted on the CoGs of thigh and shank was used to measure the motion of AL. By employing PCA, the motion of BL is estimated as shown in Figure 9. Solid line represents real angular velocities obtained by gyroscopes mounted on AL, while dashed line represents estimated angular velocities of BL calculated through (23).Figure 9
Motion estimation of IBL.By integrating angular velocities of thigh and shank calculated above, the anglesΔθ1 and Δθ2 can be obtained. Then the angle between the thigh and ground α and the angle between the shank and ground β can be calculated according to the geometric relation as shown in Figure 10(24)α=90+Δθ1,β=90-Δθ2.Figure 10
Lower limb joints geometry.Then the angle of knee joint of BL can be estimated by(25)φ=180-α+β.


## 5.1. Overview of Principal Component Analysis

Principal component analysis (PCA) is a general approach to compression and dimensionality reduction for mass data based on multivariable statistical analysis. The basic idea of PCA is to attempt to efficiently represent the data by decomposing a data space into a linear combination of a small collection of bases consisting of orthogonals that maximally preserves the variance in the data. Ifn measurements of m-tuple XT=(x1,x2,…,xm) represent original data with linear correlations, then the jthprincipal component (PC) can be expressed as(13)Pj=aj1x1+aj1x2+⋯+ajmxm∑iaji2=1.The coefficientsaji(i=1,2,…,m) are called the factor loadings. The magnitude indicates the amount of variation in variable xi that is captured by the principal component Pjand the sign indicates the nature of correlation between Pjandxi. For a given data set, PCA produces a unique solution. The common procedure of PCA can be summarized as the following 4 steps.(1) Normalization of Original Data
In order to perform PCA, the data need to have zero mean as well as stand deviation of 1 and the normalization can be achieved by(14)xij*=xij-μiσi,μi=∑j=1nxijn,σi=∑j=1n(xij-μj)(n-1),
where i=1,2,…,m;j=1,2,…,n.(2) Calculation of Covariance Matrix R
We have(15)R=1N-1X*TX*,
where X* is the normalized matrix of X.(3) Determination of the Number of PC
The eigenvectors are obtained algebraically through decomposition of the covariance matrixR of the original data. If the eigenvalue λi(i=1,2,...,m) and eigenvector γi(i=1,2,…,m) are given, the number of PC p can be determined by
(16)ηi=λi∑i=1mλi,ϵ(p)=∑i=1pηi,
where psatisfies ϵ(p)≥85%~90%.(4) Determination of Transformation matrix Γ
The transformation matrixΓ formed by the p eigenvectors of matrix R sorted in descending order of the corresponding eigenvalue
(17)Γ=(γ1,γ2,…γp)
which maps X on the new coordinates P with
(18)P=ΓTX.


## 5.2. Reconstruction of BL’s Kinematics Using AL’s Kinematics

In human gait, it has been observed that joint angle trajectories show strong linear correlations [11–13], which indicates that a compressed gait data set can be obtained by using PCA. If the original gait data X is acquired by sensors and preprocessed, the orthogonal unit eigenvector γi(i=1,2,…,m) and transformation matrix R=(γ1,γ2,…,γm) can be obtained and the new gait variables can be expressed as(19)Y=RTX.SinceR is orthogonal matrix, X can be reconstructed from Y by(20)X=RY.Ifp is determined, then the equation can be rewritten as(21)X=ΓY*,
where Γ=(γ1,γ2,…,γp), Y* is the top p rows of Y. Neglecting the last components of Y, the data is reduced in a way that the least information is lost. A reconstruction of X from the lower dimensional coordinate Y*, leads to a least-square optimal fit of the original data. PCA cannot only be used for compression, but also for reconstruction of incomplete measurements.Assuming that the first components ofX1∈ℝ(m-l) of X are known, and the remaining part X2∈ℝ(l) is unknown, (21) is separated into(22)X1=Γ1Y*,X2=Γ2Y*,
where  Γ1∈ℝ(m-l)×p and Γ2∈ℝl×p are the sub matrix of Γ. Thus X2 is reconstructed from X1 by(23)X2=Γ2(Γ1TΓ1)-1Γ1TX1.For AP coupling system, the observable data is the motion of sound leg, and the missing data is the motion of BL. To obtain the covariance matrixR, the test-bed was firstly configured as homogeneous form, CoGs of thigh and shank of two identical ALs were mounted with rate gyroscopes, and walking experiments were conducted with various cadences and stride length. The acquired data from gyroscopes were treated by following the procedures described above and the covariance matrix was obtained in the final. Then the test-bed is reconfigured as heterogeneous form and a pair of rate gyroscope mounted on the CoGs of thigh and shank was used to measure the motion of AL. By employing PCA, the motion of BL is estimated as shown in Figure 9. Solid line represents real angular velocities obtained by gyroscopes mounted on AL, while dashed line represents estimated angular velocities of BL calculated through (23).Figure 9
Motion estimation of IBL.By integrating angular velocities of thigh and shank calculated above, the anglesΔθ1 and Δθ2 can be obtained. Then the angle between the thigh and ground α and the angle between the shank and ground β can be calculated according to the geometric relation as shown in Figure 10(24)α=90+Δθ1,β=90-Δθ2.Figure 10
Lower limb joints geometry.Then the angle of knee joint of BL can be estimated by(25)φ=180-α+β.


## 6. Gait Tracking for Bionic Leg

Gait tracking control is the key to realize stable walking of AP coupling system, which belongs to time-varying trajectory tracking problem. In the heterogeneous configuration of test-bed, MR damper and electro-motors are used to actuate the joints tracking the ideal trajectories predefined in gait planning strategy. Due to the complicated dynamical characters of nonlinear, time-varying, strong coupling, and the need of high precise repetitive motion, gait tracking control is a hard difficulty in AP coupling research especially for BL that is hybrid-controlled by MR damper augmented with electro-motor. Although the methods, such as nonlinear decoupling control, decomposition feedback control, adaptive control, computed torque control, and so forth, were widely studied and proved able to solve time-varying trajectory tracking problem effectively, complex algorithm, time-consuming computation, and the need of precise and accurate system model limit the use of these methods in gait tracking control of AP coupling system. Iterative learning control (ILC) [14] can meet the special control requirement of gait tracking.ILC can be stated as follows.It is dueto repetitive motion that initial state is the same with the endθ0(0) using preceding control input and actual output error, to find a best control input which will track the reference trajectories in limited time, that is, θk(t)→θd(t);uk(t)→ud(t). θd(t) and ud(t) are the desired output and control input, and k is the number of iterative learning steps. In this paper, closed-loop ILC is combined with open loop ILC and the first order P-type open/closed-loop ILC is proposed. The control law is given by:(26)uk+1(i)=uk(i)+Γek+1(i)+Γ′ek(i),k=1,2,…,
where Γ and Γ′ are the learning gains, ek(i)=θd(t)-θ(t) is the tracking error. Initial state, that is, θ0(0)=θk(0), must be satisfied in learning phase.


## 7. Experimental Results

To validate the effectiveness of the proposed coordinated control strategy for AP interaction, the virtual prototyping-based collaborative simulation and physical prototype experiments for stable walking control for biped robot were conduct.Virtual prototype of test-bed is established using software ADAMS. Control module is built in MATLAB/Simulink. The sampling interval is 0.02 s and simulation time is 1.6 s. Relative knee joint angle tracking of BL to AL is illustrated in Figure11. The solid line represents reference knee joint angle estimated by method introduced in Section 5, while the dashed line represents the real output of ILC controller. From the figure, it can be seen that the learning was terminated after 6-step iterations when the error criterion was satisfied.Tracking curve of IBL knee joint relative angle with P-type open/closed-loop ILC.
(a)(b)(c)(d)(e)(f)The simulation result indicates that BL controlled by hybrid actuation system can track the gait of AL well.Figure12 shows the gait tracking control in swing. Figures 13, 14, 15, and 16 shows the desired and real joint angles during experiment. The results shows that P-type open/close-loop ILC control scheme is effective and can insure the BL tracking gait of AL to realize stable walking of the whole system.Figure 12
Step sequence in swing phase.Figure 13
Real and desired hip joint angle of artificial leg during swing.Figure 14
Real and desired hip joint angle of bionic leg during swing.Figure 15
Real and desired knee joint angle of artificial leg during swing.Figure 16
Real and desired knee joint angle of bionic leg during swing.


## 8. Conclusion

This paper describes the coordinated control for AP coupling system to realize symmetrical stable walking. The proposed scheme consists of walking gait synthesis, motion intention recognition, and gait tracking. Simulation and experimental results demonstrate that the proposed control scheme is correct and reasonable. The master/slave dual-leg coordinated control strategy is suitable for complex AP coupling system.



---

*Source: 139634-2010-06-06.xml*