A crawler, also known as a web crawler or web spider, is a computer program or script that systematically navigates the internet by following hyperlinks from one web page to another. Its primary purpose is to index and collect data from websites. In the context of web scraping, a crawler is used to automatically and efficiently retrieve information from multiple web pages or websites.