Fixed a bug where non 200 or 300 responses would have been crawled.