alphagov/bad_link_finder — pull request #14 by tekin (2014-03-03 11:29:44+00:00)
Title: Retry 500s as GET requests

Some servers don't like HEAD requests and will 500 so we retry any 500s as GET requests to reduce the number of false positives.