Patent ID: 8700455

Claim:
A method comprising: performing, by a computer: receiving, from a client device, a rating for an advertisement currently being served from a server during an interaction between a user of the client device and a copy of the advertisement displayed on the client device; recording data about the interaction; in response to said receiving the rating, generating a reward for the received rating including taking an action to provide a benefit to the user or on behalf of the user; serving, from the server, the advertisement to a plurality of client devices; repeating said receiving the rating, said recording the data, and said generating the reward for the received rating for a plurality of interactions between the plurality of client devices and the advertisement; analyzing the recorded data for the plurality of interactions as a group including determining a number of times the advertisement is rejected; and automatically modifying or replacing the advertisement currently being served from the server based at least in part on the number of times exceeding a threshold.