Fix seg fault caused by inclusive selection of layers/nodes to add/remove in crossover