allegro
/

plt5-base

plt5-base / tokenizer_config.json

First version of the plT5 Base model and tokenizer.

4c2c450 over 2 years ago

No virus

141 Bytes

	{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 0, "additional_special_tokens": null, "tokenizer_file": null}