allanon (pypi): A Web crawler that visit a predictable set of URLs, and automatically download resources you want from them
Keywords: crawler|robot|spider|downloader|parser|python