Patent ID: 7680858
Filing Date: 2010-03-16
Classification: G06F,G06K

Abstract:
1. A computer-implemented method for grouping structurally similar pages, comprising: normalizing each Uniform Resource Locator (URL) associated with each web page in a set of Web pages, wherein the step of normalizing each URL includes, for each URL: computing level-specific variations by, for each level of a plurality of levels, comparing the tokens that are assigned to the level only to other tokens that have been assigned to the same level to compute a level-specific variation for the level; wherein the level-specific variations indicate a measurement of URL affinity at the levels; forming a plurality of groups of said Web pages based, at least in part, on said variations; wherein the variation for a corresponding level is computed based, at least in part, on the number of distinct values of the tokens at the corresponding level relative to the total number of tokens at the corresponding level; wherein the method is performed by one or more computing devices.