xlm-v-base / tokenizer.json

Commit History

tokenizer: add fast variant
45637ff

stefan-it commited on