2021twitchfr-conv-bert-small / tokenizer_config.json
Francois Vieille
First model version
61e36a8
raw
history blame
158 Bytes
{"sep_token": "<sep>", "pad_token": "<pad>", "cls_token": "<cls>", "mask_token": "<mask>", "unk_token": "<unk>", "tokenizer_class": "PreTrainedTokenizerFast"}