Back-off from connection after a few retries.