Updated spider - more requests, MD5 of content, samples across top 1M
baysian-analysis.py now considers many more factors