Don't create/delete hover elements when there are no labels