Don't set color unless it exists.