sail
/

scaling-with-vocab-trained-tokenizers

Model card Files Files and versions Community

scaling-with-vocab-trained-tokenizers / hf_slimpajama-6B-5120-BPE /tokenizer.model

Commit History

Upload folder using huggingface_hub

bdb9681
verified

tcftrees commited on Aug 2