Patent ID: 9569534
Date: 2017-02-14
CPC Classifications: G06F,H04L

Claim:
1. A computer-implemented process for synchronizing requests with a respective context, comprising: responsive to a determination that there are more pages to explore, performing regular crawling operations for a current page; recording the current page in a list of explored pages; extracting, using a processor, links from the current page; responsive to a determination that there are more links to extract, selecting a next link to analyze to form a selected link; determining, using the processor, whether there is a new request associated with the selected link; selecting, based upon the determining whether the new request is associated with the selected link, between: selecting a set of pages to analyze wherein pages are provided in groups including logical collections of pages associated by an attribute and random selections ordered by a process rule; responsive to a determination that every page from a previous exploration was not analyzed, selecting a next page to analyze; obtaining the next page from the set of pages previously selected to form a current page; extracts all links from the current page being analyzed to form extracted links, wherein the links are representative of types of links comprising universal resource locators, form submissions, and JavaScript clicks; creating a request for each extracted links to form a set of page links A; extracting from the hashmap all requests for the current page stored during exploration time to form requests of set B; determining whether all requests from set B are analyzed; responsive to a determination that all requests from set B are not analyzed, selecting a next request from set B, as request X to analyze; selecting a corresponding request Y from set A, to analyze; determining whether the request X is equivalent to the request Y; responsive to a determination that the request X is equivalent to the request Y, adding the request X to a list AAA; responsive to a determination that the request X is not equivalent to the request Y, determining whether a difference in text is the same for all requests in set B and set A; responsive to a determination that a difference in text is the same for all requests in set B and set A, adding the request X to a list BBB; and responsive to a determination that a difference in text is not the same for all requests in set B and set A, adding the request X to a list CCC.