Site crawlers are algorithms in search engines. In Google, Google bots crawl on websites and make them available on the Google search engine index.