When add or remove events can be received out of order, but we are only interested in the latest event that occured