Changes for fast tokenizer

#6
jonatanklosko changed pull request status to open
ArthurZ changed pull request status to merged

Sign up or log in to comment