Zapotek/arachni — Issue #159: Crawler loops endlessly
Author: Yafsec
Created: 2012-02-23 12:18:34+00:00
State: open

Hi there,

First off, excellent work!
But I have a problem with the crawler on some sites.
If an URL like http://-site-/#respond?attachment_id=366 redirects back to the home page, the crawler keeps trying these URLs over and over again. The webserver just logs "GET / HTTP/1.1" 200 14101 "-" "Arachni/0.4.0.2".
Is there anything that can be done? Contact me if you need to verify.
Version 0402 cde was used and tested on ubuntu (10 and 11) and windows 7.

Thanks and greetings from Holland!