Since we cannot add labels to points, polylines and polygons yet, it would make sense to hide this field when something else than a text label is being modified. (The reverse is true as well)

Alternatively, we could enable label edition on  points, polylines and polygons.