Kristijan
/

wikitext-103_tokenizer_v2

Model card Files Files and versions Community

Kristijan commited on Mar 30, 2023

Commit

a994f55

•

1 Parent(s): 110ab39

initial commit, v2 of the tokenizer

Files changed (2) hide show

merges.txt +0 -0
vocab.json +0 -0

merges.txt ADDED Viewed

The diff for this file is too large to render. See raw diff

vocab.json ADDED Viewed

The diff for this file is too large to render. See raw diff