Patent Document ID: 20100318480
Application ID: 12792853
Patent Flag: 0

Claim One:
1. A learning control system which performs learning of action values of actions in an apparatus which identifies its state as one of predetermined states, and selects an action based on the obtained action values and the identified state, the system comprising: n action value learning devices including the first to the n th learning devices which perform learning of n action values from Q 1 to Q n respectively, assuming that n is a positive integer; and an action value determining device which determines the total action value of an action Q of each state based on the n action values of the n action value learning devices, wherein the first target value of the first action value learning device is determined based on the reward r that is obtained after an action has been carried out by the next state and a total action value Q′ that was prepared for the action selection in the next state, and the first learning device updates the first action value Q 1 using the first target value and wherein when n is 2 or more, the n-th target value of the n th action value learning device is set to the difference between the (n−1) th target value of the (n−1) th learning device and the action value Q n-1 , and the n th learning device updates the n th action value Q n using the n th target value.