Patent ID: 11392104

Abstract:
A computing system for generating optimal tracking control (TC) policies for controlling a machine to track a given time-varying reference (GTVR) trajectory. An updated augmented state of the machine is obtained. Stored in memory is the GTVR trajectory, a constraint-admissible invariant set (CAIS) of machine states satisfying machine state constraints and a corresponding TC policy mapping a machine state within the CAIS to a control input satisfying control input rate constraints. A processor jointly controls the computing system to control the operation to drive an augmented state of the machine to zero, and update the CAIS and TC policy. Joint control includes using a sequence of control inputs and a sequence of augmented machine states within CAIS corresponding to the sequence of tracking control inputs. Execute a constrained tracking approximate dynamic programming (TADP) using the received data to update the value function, update the CAIS and the corresponding TC policy.