moussaKam commited on
Commit
7d64cae
1 Parent(s): b56c5b9

Add tokenizer.json, Modify sentencepiece model

Browse files
Files changed (3) hide show
  1. sentencepiece.bpe.model +0 -0
  2. tokenizer.json +0 -0
  3. vocab.json +0 -0
sentencepiece.bpe.model CHANGED
Binary files a/sentencepiece.bpe.model and b/sentencepiece.bpe.model differ
 
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
vocab.json DELETED
The diff for this file is too large to render. See raw diff