tokenizer_equal_NFKC_250k / tokenizer.json
RomanCast's picture
Initial commit
73799a9
This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

  • SHA256: d4933e3dcab51c305b69ec0e52255c6326d9d7befddbb20b6b262fc1eae62fd3
  • Pointer size: 133 Bytes
  • Size of remote file: 18.7 MB

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.