Merge branch 'master' of https://github.com/stewartmckee/cobweb
Adding Makefile so that we can run the build using Jenkins in the same
manner that we run ganymede
Merge branch 'master' of github.com:ephox/cobweb
Fixing makefile to be correct dependency chain
Merge branch 'cobweb2'
Simplifying the crawling mechanisms so that link finding and processing are distinct entities. This means that the processing doesnt need to know anything about
the link finding and makes each part a lot conceptually simpler. Also makes it much easier to reason about since we are not dealing with mutliple
redis locks.
Merge branch 'master' into 784-requeue-on-termination-signal