Prevent multiple removals of the same layer from the display. More work needs to be done to clean up hanging layers.