tiny-random-OpenAIGPTLMHeadModel / tokenizer_config.json

Upload tiny models for OpenAIGPTLMHeadModel

bc3ef31 about 1 year ago

No virus

172 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 512,
	"special_tokens_map_file": null,
	"tokenizer_class": "OpenAIGPTTokenizer",
	"unk_token": "<unk>"
	}