T5-CareerBud / tokenizer_config.json
ali-alkhars's picture
Create tokenizer_config.json
bca345b verified
raw
history blame contribute delete
No virus
152 Bytes
{
"model_max_length": 500,
"vocab_size": 32128,
"model_input_names": ["input_ids", "attention_mask"],
"tokenizer_class": "T5Tokenizer"
}