When pruning intermediate state between segments using mode invariants,
permit some of the modes to disappear as long as at least one remains.