theSOL1
/

kogrammar-distil

Text2Text Generation

Inference Endpoints

Model card Files Files and versions Community

kogrammar-distil / tokenizer_config.json

theSOL1's picture

Upload 7 files

4e8bda9 12 months ago

raw history blame contribute delete

217 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"max_length": 512,
	"model_max_length": 1000000000000000019884624838656,
	"padding": "max_length",
	"tokenizer_class": "PreTrainedTokenizerFast",
	"truncation": false
	}