The Component wasn't tracking selection IDs properly for labels and markers.  Holding on to them too long.