wav2vec2-large-xlsr-53-frisian / tokenizer_config.json
wietsedv's picture
Fix character whitelist
6e8c169
raw
history blame
163 Bytes
{
"unk_token": "<unk>",
"bos_token": "<s>",
"eos_token": "</s>",
"pad_token": "<pad>",
"do_lower_case": true,
"word_delimiter_token": "|"
}