LeoCordoba
/

beto2beto-mlsum

Summarization Transformers PyTorch Safetensors Spanish encoder-decoder text2text-generation spanish beto Eval Results Inference Endpoints

Model card Files Files and versions Community

beto2beto-mlsum / tokenizer_config.json

LeoCordoba's picture

commit files to HF hub

ebb269e about 3 years ago

raw history blame contribute delete

No virus

323 Bytes

	{

	"do_lower_case": true,

	"unk_token": "[UNK]",

	"sep_token": "[SEP]",

	"pad_token": "[PAD]",

	"cls_token": "[CLS]",

	"mask_token": "[MASK]",

	"tokenize_chinese_chars": true,

	"strip_accents": false,

	"do_basic_tokenize": true,

	"never_split": null,

	"model_max_length": 512

	}