Remove menu layers from window before attempting to add them again