collection synthesis
The invention of the hyperlink and the HTTP transmission protocol caused an amazing new structure to appear on the Internet -- the World Wide Web. With the Web, there came spiders, robots, and Web crawlers, which go from one link to the next checking Web health, ferreting out information and resources, and imposing organization on the huge collection of information (and dross) residing on the net. This paper reports on the use of one such crawler to synthesize document collections on various topics in science, mathematics, engineering and technology. Such collections could be part of a digital library.
collect synthesis hyperlink linking structure internet world wide web web robotics health informal resource organization paper use documentation science mathematics engine technologies digital libraries information retrieval clustering nsdl crawling mercator topic management