Crawls all unique links.