alphagov/govuk_crawler_worker — pull request #76 by mattbostock (2014-09-03 13:17:35+00:00)
Title: Continue to next item if content-type unknown

Continue to the next item if the MIME content type cannot be determined.