Erfan11
/

Neuracraft

Model card Files Files and versions Community

Neuracraft / tokenizer_config.json

Erfan11's picture

Create tokenizer_config.json

d2a2f05 verified 27 days ago

116 Bytes

	{
	"do_lower_case": true,
	"model_max_length": 512,
	"tokenizer_class": "BertTokenizerFast",
	"use_fast": true
	}