Crawling is the process of looking at every page on a website to find out what content it has. When Google indexes a website, it examines every page to determine how many are related to specific search terms.