Patent ID: 7827254

Claim:
A method performed by a computer system, the method comprising: retrieving, by a processor associated with the computer system, a first plurality of uniform resource locators (URLs), where one or more URLs of the first plurality of URLs include a parameter string comprising at least one parameter and a value associated with the at least one parameter; selecting, by a processor associated with the computer system, one or more parameters present in at least a particular number of parameter strings of, respectively, the first plurality of URLs; selecting, by a processor associated with the computer system, a first URL from the retrieved first plurality of URLs, where the first URL includes the selected one or more parameters; generating, by a processor associated with the computer system, a second plurality of different URLs including, respectively, different parameter combinations of the selected one or more parameters, where the parameter combinations include each combination of the selected one or more parameters; retrieving, by a processor associated with the computer system, content using the first URL; retrieving, by a processor associated with the computer system, contents using, respectively each of the second plurality of different URLs; comparing, by a processor associated with the computer system, the content retrieved using the first URL to the content retrieved using each of the second plurality of different URLs; identifying, based on the comparing, one of the parameter combinations, that, when present in a particular URL, results in retrieving content that is approximately the same as the content corresponding to the first URL, the identifying being performed by a processor associated with the computer system; generating, by a processor associated with the computer system, one or more URL rewrite rules based on the identified one of the parameter combinations; and indexing the first plurality of URLs and the second plurality of URLs based on the one or more URL rewrite rules.