Fix bug with adding/removing layers in net crossover