Invalidate view models when varz component(s) removed