Add failure delay to avoid excessive requests

Add failure delay to avoid excessive requests.

/cc @maximeprades @jeremiahcurrier @zendesklabs/quokka