Remove branch / tag icon if there are no branches / tags.