Patent ID: 8180761
Filing Date: 2012-05-15
Classification: G06F

Abstract:
1. A method of prioritizing a web crawler target link queue, comprising: retrieving referrer context information associated with a link to a remote object with respect to a plurality of client devices, the referrer context information identifying how the link was spread among the plurality of client devices, wherein the link is spread among the plurality of client devices via a plurality of different networking protocols and the retrieved referrer context information is different for the different networking protocols via which the link was spread; aggregating the retrieved referrer context information; analyzing the aggregated retrieved referrer context information for the link to the remote object to determine whether the aggregated retrieved referrer context information identifying how the link was spread among the plurality of client devices indicates a threat to the plurality of client devices; and prioritizing the link to the remote object within the web crawler target link queue relative to other links in the web crawler target link queue based on the analyzed aggregated retrieved referrer context information, wherein a priority of the link is increased responsive to the determination that the aggregated retrieved referrer context information indicates the threat to the plurality of client devices.