Searching and Databases on the Web 15.3. This process is called indexing. Gatherer and indexer are combined into one, such as robot gatherer, in some search systems, in which the gatherer traverses the Web and creates records at the same time.
Indexing is the key component of the search system.
An effective indexing process will yield high-quality records that represent accurately collection of resources, and that better describe the documents. Searching a high-quality index leads to precise identification and correct retrieval of resources. In fact, the principle of indexing for a search system of the Web is virtually the same as for a traditional database. In a traditional database, a record is a set of values treated as a unit. For example in a library catalog, a record for a book may consists of title, author, publisher, subject, and so on.