spider.py (pypi): FTP and Web spiders and mirroring utilities
Keywords: spider|robot|crawler|ftp|web|web-bot|link|checker|bad|finder