Patent ID: 11880188
Assignee: VIRGINIA TECH INTELLECTUAL PROPERTIES, INC.
Field: Control (Instruments)
Classification: CPC G | IPC G

Claim 12:
13. The system of claim 11, wherein a policy iteration routine comprises applying the at least one transformation until a predetermined epsilon convergence is observed by:
selecting an epsilon value for detecting convergence of the unconstrained policy to the optimal constrained policy;
evaluating the unconstrained policy by solving a Linear Programming formulation for the epsilon value of the unconstrained policy;
improving the unconstrained policy by applying a dynamic-programming update that generates a new set of candidate machine states for the unconstrained policy;
comparing a first plurality of vectors of the new set of candidate machine states to a second plurality of vectors of the unconstrained policy; and
modifying a finite state controller of the unconstrained policy until the optimal finite state controller is determined.