Fix issue when removing all segments

The old segments UIView were not removed.