stablelm-2-1_6b / tokenizer_config.json
jon-tow's picture
init: release
3aeae29
raw
history blame
No virus
160 Bytes
{
"tokenizer_class": "Arcade100kTokenizer",
"auto_map": {
"AutoTokenizer": [
"tokenization_arcade100k.Arcade100kTokenizer",
null
]
}
}