Patent ID: 8909590
Filing Date: 2014-12-09
Classification: G06N

Abstract:
1. A computer implemented method, comprising: obtaining an indication that a decision has been requested or selected with respect to one or more users; determining whether to schedule, request, or perform a set of one or more activities, the set of one or more activities including performing one or more updates and selecting one or more decisions, wherein the one or more updates are performed with respect to a value function approximating an expected reward over time for the one or more users and a policy for selecting additional decisions, and wherein the one or more decisions pertain to the one or more users; and scheduling, requesting, or performing the set of one or more activities according to a result of the determining step, wherein scheduling, requesting, or performing the set of one or more activities comprises: generating a sequence of requests, wherein the sequence of requests includes one or more Update Requests and one or more Decision Requests, wherein each request in the sequence of requests pertains to the one or more users; and providing or transmitting each request in the sequence of requests or indication thereof according to a particular schedule, wherein each of the one or more Decision Requests indicates a request to select an additional decision with respect to the at least one user, wherein each of the Update Requests indicates at least one of: a request to update a value function approximating an expected reward over time for the one or more users and a request to update a policy for selecting additional decisions.