roberta_sfda_sharpseed / tokenizer_config.json
system's picture
system HF staff
Update tokenizer_config.json
75b6ed1
{"additional_special_tokens": ["<e>", "</e>"], "model_max_length": 512}