greyfoss
/

simple-gpt-doupo

Text Generation

Inference Endpoints

Model card Files Files and versions Community

simple-gpt-doupo / tokenizer_config.json

greyfoss's picture

Upload tokenizer

5fbe04d verified 5 months ago

raw history blame contribute delete

No virus

118 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 512,
	"tokenizer_class": "PreTrainedTokenizerFast"
	}