Patent ID: 8688534

Claim:
A method comprising: receiving at a data mining system, a product URL; determining, using a hardware processor of the data mining system, whether the product URL has a pattern of alphanumeric characters, numbers or symbols that is defined by a regular expression, wherein the regular expression defines a rule that represents URLs as a sequence of alphanumeric characters, numbers or symbols; if the product URL has the pattern defined by the regular expression, generating a unique link ID associated with the product URL by extracting the alphanumeric characters, numbers or symbols from the product URL based on the regular expression; retrieving from a database a product ID corresponding to the unique link ID; retrieving from the database one or more product links that correspond to the product ID; traversing the one or more product links; parsing, by the processor, a web-page corresponding to each of the one or more product links to determine product information; and displaying the product information, via a display device, to a user.