A crawler for visit a predictable set of URLs, and download resources from them