holgerd77/django-dynamic-scraper — pull request #24 by scoarescoare (2013-07-28 15:31:56+00:00)
Title: Added FOLLOW pagination type.

This only follows pages (dynamically) after crawling all of the links in the base page. If you have any interest in this PR, I can flesh out the implementation and docs.