Added the ability to index tokens from semantics parser.