Prevents the add/remove events from triggering a compare on the entire collection