Sleep even if we don't get exception on reconnect.