Only set Text.label.color if it has not changed