make utf8 encoding task more robust
for HTTP failing URLs, leave a cool down period (mark_as_failed for 1 hour)