There are various ways a user can search this database such as by individual fields or by location. Users' search terms are ANDed together for them. Harvest Rather than employing one spider to carry out all of the various tasks required in indexing WWW, gopher, and FTP sites, Harvest employs a number of subsystems. The first, the Gatherer, collects information on servers. Next the Broker takes the information the Gatherer collected and adds it to the database.
Users can search using Boolean operators and proximity operators.
There is full-text indexing in this database. Although they are useful tools, robots can cause problems, consequently there are many people who do not like them. There are a number of valid reasons for this. Sometimes robots can make too many requests at a server, they may retrieve a large number of documents in a very short period of time. Furthermore, they will even repeatedly ask for the same document or visit the same site numerous times.