sail
/

scaling-with-vocab-trained-tokenizers

Model card Files Files and versions Community

scaling-with-vocab-trained-tokenizers / hf_slimpajama-6B-16384-BPE

1 contributor

History: 1 commit

tcftrees's picture

Upload folder using huggingface_hub

bdb9681 verified 4 months ago

special_tokens_map.json

411 Bytes

Upload folder using huggingface_hub 4 months ago
tokenizer.model

503 kB
LFS

Upload folder using huggingface_hub 4 months ago
tokenizer_config.json

746 Bytes

Upload folder using huggingface_hub 4 months ago