Remove unresponsive peers

Remove a peer if the connection is closed before the version exchange
has been completed