add a web_scan module (replaces robots_txt). rename spider_web_application -> web_spider, and make both modules more robust, along with dns_sub_brute. also a handy update server list for cache snooping. so many goodies...