blenderbot-3B / tokenizer_config.json
lysandre's picture
lysandre HF staff
Adds tokenizer_config.json file
b01fcec verified
raw
history blame
98 Bytes
{"add_prefix_space": true, "tokenizer_class_name": "BlenderbotTokenizer", "model_max_length": 128}