Handle how removing connections for the master works.