Crawling the web recursively