Patent ID: 7941420

Claim:
A computer-implemented method to organize structurally similar Uniform Resource Locators (URLs, the method comprising: for each particular document of a plurality of documents, performing particular steps comprising: generating one or more shingles that represent a structure of the particular document; generating an appended URL for the particular document by appending, to a URL of the particular document, a sequence of parameters and values of those parameters, wherein the sequence includes a separate parameter for each shingle of the one or more shingles generated for the particular document, and wherein the value of each parameter is the value of a shingle to which that parameter corresponds; tokenizing the appended URL into components based on delimiters present in the appended URL; and adding the components produced by said tokenizing to a total set of components for the plurality of documents; after performing said particular steps for each particular document of the plurality of documents, clustering the components from the total set of components into a hierarchical organization by, for each particular component of the total set of components that does not occur at the beginning of any appended URL, setting that particular component to be a child, in the hierarchical organization, of another component that occurs immediately before the particular component in an appended URL in which the particular component occurs; and storing the hierarchical organization.