add support for spidering
Merge branch 'master' of https://github.com/mozilla/collusion