tokenizer_equal_nfkc_24M / tokenizer_config.json
RomanCast's picture
Initial commit
2592db6
This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

  • SHA256: e9b356747f34065a9d8b548fabede48ffbb5cd72c87579b6e8c4ddf8d9a730c5
  • Pointer size: 128 Bytes
  • Size of remote file: 131 Bytes

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.