Fix a (documented) race condition when a component is removed from the configuration
after having encountered errors during a previous run.