KBLab
/

wordpiece-32k-pretok-small_data-tokenizer

Model card Files Files and versions Community

wordpiece-32k-pretok-small_data-tokenizer / special_tokens_map.json

Commit History

Upload tokenizer

bfe39a1

robinq commited on Jan 26, 2023