This is not a full token cache. This cache only contains disambiguation between keywords and NCNames (couple of tokens usually if any).
The XQuery mode could use it's own background tokenizer but we would still need to keep these couple of tokens somewhere separate in cache. Does it make sense? What do you think?