moussaKam commited on
Commit
c89de60
1 Parent(s): a733cdd

Add tokenizer.json, Modify sentencepiece model

Browse files
Files changed (2) hide show
  1. sentencepiece.bpe.model +0 -0
  2. tokenizer.json +0 -0
sentencepiece.bpe.model CHANGED
Binary files a/sentencepiece.bpe.model and b/sentencepiece.bpe.model differ
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff