Patent ID: 9082081
Filing Date: 2015-07-14
Classification: G06N

Abstract:
1. An information processing apparatus comprising: a central processing unit (CPU) operable to: use action history data, which includes state data expressing a state of an agent, action data expressing an action taken by the agent in the state, and a reward value expressing a reward obtained by the agent as a result of the action, as learning data to generate, through machine learning, a reward estimator that estimates a reward value from the inputted state data and the action data; generate a plurality of basis functions by combining a plurality of processing functions; calculate feature amount vectors by inputting the state data and the action data included in the action history data into the plurality of basis functions; calculate an estimation function that estimates the reward value included in the action history data from the feature amount vectors according to regressive/discriminative learning, wherein the reward estimator includes the plurality of basis functions and the estimation function; input, into the reward estimator, state data expressing a present state in which an agent is present and action data expressing actions that can be taken next by the agent to estimate reward values obtained by the agent as a result of taking the actions; and select an action that has a highest reward value out of the actions that can be taken next by the agent in the present state.