Spiders, Crawlers, and Bots are what the search engines send out to your site to determine which pages will be listed in the search engine index.