Remove an ID we no longer need