gpt-neox-tokenizer-digits / tokenizer_config.json
ArthurConmy's picture
Add change
8a0a1f6
raw
history blame
44 Bytes
{
"tokenizer_class": "GPTNeoXTokenizer"
}