cgiffard/node-simplecrawler — pull request #78 by leeroybrun (2014-05-23 13:40:53+00:00)
Title: Add maxSameRedirects option

Now we can handle redirects to the same page with a limit (to avoid infinite loop). The default limit is 0 (we don't follow redirects to the same page).

Some websites redirect to the same page e.g. after setting some cookies. With this option we can follow the redirect but avoid infinite loops.