Patent ID: 8738555
Filing Date: 2014-05-27
Classification: G06N

Abstract:
1. A data processing device comprising: one or more processors operable to: calculate a state value having a predetermined state of a state transition model set as a reference, wherein a value of the state value increases as much as a state with a high transition probability to another state close to the predetermined state, wherein a state in the state transition model is transited by an action performed by an agent, and wherein the state value is calculated for each state of the state transition model based on the state transition model of each action; calculate an action value, for each state of the state transition model and each action that the agent can perform, based on the state transition model and the state value having the predetermined state set as the reference, wherein a value of the action value increases as a transition probability to a state with a high state value having the predetermined state set as the reference increases; set a state with a variance in the action value higher than a predetermined threshold among states of the state transition model to a target state, the target state being a target to reach by an action performed by the agent; and select an action of the agent so as to move toward the target state.