byT5-DRS-sled / tokenizer_config.json
XiaoZhang98's picture
Upload 3 files
cac2827
{
"tokenizer_class": "SledTokenizer",
"base_tokenizer": "XiaoZhang98/byT5-DRS",
"model_max_length": 16384
}