Patent ID: 7424484

Claim:
A computer implemented method for path-based ranking of unvisited Web pages for WWW crawling, comprising: identifying all the paths beginning with a “seed” URL and leading to visited web pages containing content relevant to a search as “good-path set”, and for each unvisited web page, identifying the paths beginning from the “seed” URL leading to it as “partial-path set”; classifying all the visited web pages and labeling each web page with the labels of a class or classes it belongs to; training a statistic model for generalizing the common patterns among all ones of good-path set; and evaluating the partial-path sets with the statistic model to determine a similarity between the partial-path sets and all ones of good-path set and ranking the unvisited web pages with the evaluation results, whereby the highest ranked unvisited web pages are those most likely to contain content relevant to the search.