Fix reconnect on connection refused or other early error