ArthurZ HF staff jonatanklosko commited on
Commit
b1397f9
1 Parent(s): c5e8f38

Changes for fast tokenizer (#5)

Browse files

- Add tokenizer.json (188aef90df69b620ce6cfd6e40b9584aeeb26562)


Co-authored-by: Jonatan Kłosko <jonatanklosko@users.noreply.huggingface.co>

Files changed (1) hide show
  1. tokenizer.json +0 -0
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff