Changes for fast tokenizer

#5
jonatanklosko changed pull request status to open
ArthurZ changed pull request status to merged

Sign up or log in to comment