niklassheth
/

tinystories-tokenizer

Model card Files Files and versions

tinystories-tokenizer / tokenizer.json

niklassheth's picture

Upload custom TinyStories BPE tokenizer (vocab_size=8192)

9d85d76 verified 7 months ago

history contribute delete

561 kB

File too large to display, you can check the raw version instead.