madlad400-3b-mt / tokenizer.json
jbochi's picture
Add fast tokenizer
58471d6
This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

  • SHA256: 15aa9b3cbcf2ec220c6044f898e27fd302067a336df5369ec55a8f385f849d3b
  • Pointer size: 132 Bytes
  • Size of remote file: 8.24 MB

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.