Finding Information on the World Wide Web can be time-consuming and challenging. When one click of a hyperlink can send you anywhere, it can be hard to keep track of where you are, let alone to get where you want to go. Various search tools, developed in recent years, have attempted to organize the information found across the Internet. The rapid growth of search tools and services, while providing helpful aids for the Internet user, has also resulted in confusion about their effectiveness and use. Using specialized or customized services that focus on limited topics.
Directories create a table of contents for the Internet.
They are best suited for browsing because the links are arranged by subject. Directories are useful for people who have a general idea about the information they are seeking, but just don't know where to start. These automated programs are also known as spiders, crawlers, wanderers, and worms. The robots crawl around the Web indexing Web sites. Some index by title, some by URL's, some by words in each document, and some by combinations of these.