Patent ID: 8504551

Claim:
A computer-implemented method comprising: a) extracting, automatically by a computer system including one or more computers on a network and from a first set of untargeted Websites, a first set of document information extracted from a shallow crawl of the first set of untargeted Websites; b) storing, by the computer system, the first set of document information that was extracted from a shallow crawl of the first set of untargeted Websites, in a first storage repository; c) extracting, automatically by the computer system and from a second set of targeted Websites, a second set of document information extracted from a deep crawl of the second set of targeted Websites, wherein the targeted Websites include i) Websites provided by content providers having available advertisement spots, and ii) Web pages identified in earlier, unfilled, content relevant advertisement requests, content relevant advertisement requests; and d) storing, by the computer system, the second set of document information that was extracted from a deep crawl of the second set of targeted Websites, in a second storage repository different from the first storage repository.