roberta-base-64k / tokenizer_config.json
bab2min's picture
added the model
dc6a836
raw
history blame
71 Bytes
{
"model_max_length": 512,
"tokenizer_class": "KiwiTokenizer"
}