Crawler improvement for response codes >= 300 and < 400.