TransactionAssociationSet tracks removed items, too