Patent ID: 6418452
Filing Date: 2002-07-09
Classification: G06F,Y10S

Abstract:
In a computer network comprising a master repository service machine, a plurality of web server machines, and a web crawler machine, a method comprising:a) automatically maintaining on each of the web server machines a file modification list describing modifications made to corresponding web content files stored thereon; b) transmitting from each of the web server machines to the master repository service machine a web site modification report derived from the file modification list, wherein the web site modification report comprises a last updated time indicating when web content on the corresponding web server machine was last updated; c) transmitting from the web crawler machine to the master repository service machine a request for web site modification information, wherein the request comprises a last visited time indicating when the web crawler machine last visited the master repository service machine; and d) transmitting from the master repository service machine to the web crawler machine the requested web site modification information, wherein the requested web site modification information comprises web server identifiers corresponding to updated web servers whose last updated time is later than the last visited time of the web crawler machine.