add index from tokenizer

#3
Publish this branch
This branch is in draft mode, publish it to be able to merge.

Sign up or log in to comment