stefan-it's picture
tokenizer: add configuration and vocab
13da9be
File too large to display, you can check the raw version instead.