Smart distributed web crawler
A Novel Architecture of a Parallel Web Crawler