gpt1_original-pretrain_xnli-head-24 / tokenizer_config.json

Training in progress, step 1000

55521c4 10 months ago

No virus

163 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 512,
	"padding_side": "left",
	"tokenizer_class": "OpenAIGPTTokenizer",
	"unk_token": "<unk>"
	}