megatron-bert-base-swedish-cased-600k / tokenizer_config.json

Joey Öhman

add tokenizer

8edc2d3 over 2 years ago

No virus

169 Bytes

{"special_tokens_map_file": "pretrained_model_hf_600K/special_tokens_map.json", "name_or_path": "pretrained_model_hf_600K", "tokenizer_class": "PreTrainedTokenizerFast"}