have to copy original token index over as well to transformed token.