do not add crazy urls into spiderdb
Merge branch 'master' into testing
try to fix cisco.com canonical redirecting out.
fix docs in collection count