Crawling is a discovery process in which the search engine sends out a team of robots and they are in charge of finding and updating the latest content.