raw_wiki.sn / tokenization.model
kushaltatariya's picture
Upload tokenizer
793349e verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
52be05c21b57fea7605c40b0ff85a72dd79ba61d8baecdb2dd0bcaa540902dae
Pointer size:
131 Bytes
·
Size of remote file:
307 kB
·
Xet hash:
9a0ecae10bf1ac792a613f6f18f9613aa21e353265c9787ce8f2644a143a1993

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.