Patent ID: 7953741

Claim:
A computer-implemented method, comprising: for each of a plurality of resources presented to a plurality of users by a data processing service: receiving one or more signals originating from the data processing service reporting one or more actions by the plurality of users related to the respective resource, wherein a reported action is a presentation of the respective resource, an addition of the respective resource, or a deletion of the respective resource, wherein the reported actions comprise one or more short deletions of the respective resource, a short deletion of the respective resource being a deletion of the respective resource occurring within a predefined time period after a corresponding addition of the respective resource; determining a number of long additions for the respective resource by subtracting a number of short deletions of the respective resource from a number of reported additions of the respective resource; and determining a respective long-addition click-through rate (LACTR) for the respective resource by dividing the number of long additions for the respective resource by a number of reported presentations of the respective resource; ranking the plurality of resources based on the respective LACTRs for the plurality of resources; and providing the ranking of the plurality of resources to the data processing service, wherein receiving, determining, ranking, and providing are performed by one or more computers.