tokenizer_equal_nfkc_24M / tokenizer.json
RomanCast's picture
Initial commit
2592db6
This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

  • SHA256: e043ca2dbde5befb8a62fdd2ab102f386d632ef61022daefa1050a24cb5631f8
  • Pointer size: 133 Bytes
  • Size of remote file: 10.6 MB

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.