vietnhatthai
/

test_pretrain_pipeline

Text Generation

generated_from_trainer

Inference Endpoints

Model card Files Files and versions Community

test_pretrain_pipeline / tokenizer_config.json

vietnhatthai's picture

End of training

52d175c 10 months ago

raw history blame contribute delete

No virus

137 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 512,
	"tokenizer_class": "OpenAIGPTTokenizer",
	"unk_token": "<unk>"
	}