bertin-base-pos-conll2002-es / tokenizer_config.json

Gaussian 512 fine-tuned POS CoNLL 2002 es with f1/acc 0.9646/0.9697

843ce7b almost 3 years ago

No virus

338 Bytes

{"unk_token": "<unk>", "bos_token": "<s>", "eos_token": "</s>", "add_prefix_space": true, "errors": "replace", "sep_token": "</s>", "cls_token": "<s>", "pad_token": "<pad>", "mask_token": "<mask>", "special_tokens_map_file": null, "name_or_path": "bertin-project/bertin-base-gaussian-exp-512seqlen", "tokenizer_class": "RobertaTokenizer"}