Netscape, HotBot, Lycos etc. However it is still a manual directory and can hardly scale with the fast growth of the Web. To keep up with the fast growth of the Web, IBM Santa Teresa Research Lab has been researching automatic Web categorization. 20 4.2.1 Capabilities and features Most queries posted to search engines are very short. However the dramatic boost in accuracy is at some cost of coverage.
Manual categorization faces the scalability problem.
The librarians work can hardly keep up with the fast growth of the Web. No company could ever hire enough experts to categorize the Web. P. Indyk S. Chakrabarti, B. Dom. Enhanced hypertext categorization using hyperlinks . In this section, we discuss graph collapsing algorithms for reducing the complexity of the graph to aid visualization.