chriskite/anemone — pull request #61 by gnapse (2012-07-24 13:27:12+00:00)
Title: add the ability to stop the crawl

I had the need to stop the crawl at will, and added this new feature.

There's a new method that client code can call from within a page block, and will make the crawl to stop after the current page is processed. The crawled is stop nicely, not forcefully killing the tentacle threads, but clearing the queues so that the natural ending process occurs.

Hope this helps someone out there.