ArthurZ HF staff jonatanklosko commited on
Commit
fb68d4f
1 Parent(s): a32f252

Changes for fast tokenizer (#6)

Browse files

- Add tokenizer.json (5c1c49890768bbc85186f6da2881d657f4b7878a)


Co-authored-by: Jonatan Kłosko <jonatanklosko@users.noreply.huggingface.co>

Files changed (1) hide show
  1. tokenizer.json +0 -0
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff