Keep track of added/removed targets for setModel.save()