tokenizer-dna-mlm / tokenizer_config.json
gonzalobenegas's picture
Upload 3 files
352620e
raw history blame
No virus
125 Bytes
{
"mask_token": "[MASK]",
"pad_token": "[PAD]",
"tokenizer_class": "PreTrainedTokenizerFast",
"unk_token": "[UNK]"
}