add options to constrain page and link queues by size

This feature can provide a means to lower the memory usage of the crawler under certain circumstances.
add the ability to stop the crawl
Merge branch 'stop-crawl' into next
Merge https://github.com/gnapse/anemone into next