nreimers commited on
Commit
ef7264e
1 Parent(s): 113e20c

add tokenizer info

Browse files
Files changed (3) hide show
  1. merges.txt +0 -0
  2. tokenizer.json +0 -0
  3. vocab.json +0 -0
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
vocab.json ADDED
The diff for this file is too large to render. See raw diff