Check whether we've already processed a disconnection before gladly re-removing on connectionLost