Search engines scan the Internet using their own web crawlers, and fortunately we don't have to do it ourselves. These web crawlers are usually called search engine bots or spiders. A search engine navigates the Web by downloading Web pages and following backlinks on those pages to discover new Web pages that have been made available.