Correctly removes the extended layers when 'Nothing' is selected