robot-test
/

dummy-tokenizer-fast-with-model-config

add tokenizer example with model config

8a27784 almost 3 years ago

No virus

73 Bytes

	{ "model_type": "albert", "tokenizer_class": "PreTrainedTokenizerFast" }