A robot is a program designed to follow the hyperlinks that hold the Web together, gathering information on the various sites they encounter along the way. For more information, visit the comprehensive Web Robots Pages .
Robots are neither inherently good or evil.
But robots also have a knack of finding some pages you would have preferred to hide. Some Website-indexers make it easier by providing request forms. Putting in requests with ALL these services can, however, take a lifetime. Fortunately, many robots are well-mannered and may be told what they can and cannot peek at. All Rights Reserved.