Patent ID: 11966949
Assignee: CAPITAL ONE SERVICES, LLC
Field: IT methods for management (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform a method for targeting bid and position for a keyword by tracking users interacting with webpages or links for keywords, the method comprising:
obtaining observations of value with respect to position for the keyword, the observations being based at least on keyword value information, the keyword value information being associated with the keyword based on monitoring user interactions;
receiving a Gaussian Process Model configured to obtain a prediction function and associated uncertainties;
applying the Gaussian Process Model on the observations to obtain the prediction function and associated uncertainties, the prediction function and the associated uncertainties relating positions to expected values;
receiving a Thompson sampling reinforcement learning model configured to obtain a target position;
applying the Thompson sampling reinforcement learning model on the expected values and the positions to obtain a target position the applying the Thompson sampling reinforcement learning model including an agent taking one of one or more action(s) from an action function according to a policy, the one or more action(s) including an exploit action or an explore action, the exploit action or the explore action being chosen according to an exploit-explore ratio of the policy;
obtaining historical bid position data including a value-position-time set for the keyword;
applying a backwards filtering model to the historical bid position data to form a bid-to-position function;
determining bid information using the target position and the bid-to-position function; and
transmitting a bid message to a search engine, the bid message including the bid information.