tokenizer_alpha_NFKC_250k / tokenizer.json
RomanCast's picture
Initial commit
4a8a537
This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

  • SHA256: 8c79d3266efdf94b1566fc9b8c96a6eb1e29ed2ce6104db651d8027c504a096b
  • Pointer size: 133 Bytes
  • Size of remote file: 17.9 MB

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.