when we start peer manager if we have previously connected peers we abandon them.