robots.txt needs to be more inclusive

Need to block web crawlers from all cgi