Patent ID: 9047423
Filing Date: 2015-06-02
Classification: G06F,G06N,G06Q

Abstract:
1. A method for choosing actions in a current state of a planning problem, the method comprising: partitioning a representation of states of a planning problem into a base state representation and a contextual state representation, said contextual state representation providing contextual variables configurable for a regression analysis; running, in a simulation model of said current state of a planning problem, a plurality of simulation trials initiated from at least one available top-level action in said current state resulting in a simulated reward outcome, wherein at least one of said plurality of simulation trials performs one or more simulation steps, a simulation step comprising: recommending, upon completion of said simulation trials, an action to perform in said current state of a planning problem, responsive to said simulated reward outcome obtained in said simulation trials, wherein a computing system including at least one processor and at least one memory device connected to the processor performs the partitioning, running, simulating, forming, training, estimating selecting, and recommending.