Patent ID: 11880188
Assignee: VIRGINIA TECH INTELLECTUAL PROPERTIES, INC.
Field: Control (Instruments)
Classification: CPC G | IPC G

Claim 10:
11. A system for implementing a constrained-action partially-observable Markov decision process (CA-POMDP), comprising:
at least one computing device; and
program instructions executable in the at least one computing device that, when executed, direct the at least one computing device to:
generate an unconstrained policy through execution of a partially observable Markov decision process (POMDP) routine;
generate an optimal constrained policy by a discrete and combinatorial optimization routine that applies at least one transformation to a finite state controller, the optimal constrained policy generated comprising an optimal finite state controller having a threshold probability of operating within at least one operational constraint within a period of time;
apply a probabilistic constraint satisfaction routine to bring the optimal finite state controller within a probabilistic constraint satisfaction threshold; and
determine to perform an action based at least in part on a current state of the at least one computing device and the optimal finite state controller.