ENLP
/

mrasp2

feature-extraction

Inference Endpoints

Model card Files Files and versions Community

mrasp2 / tokenizer_config.json

thehonestbob's picture

Upload 11 files

5f10714 12 months ago

raw history blame contribute delete

No virus

207 Bytes

	{
	"langs": [
	"en",
	"zh"
	],
	"model_max_length": 300,
	"tokenizer_class": "FSMTTokenizer",
	"auto_map": {
	"AutoTokenizer": [
	"tokenization_bat.FSMTTokenizer",
	null
	]
	}
	}