wav2vec2-xlsr-530-serbian-colab / tokenizer_config.json

add tokenizer

12aa287 over 1 year ago

No virus

236 Bytes

	{
	"bos_token": "<s>",
	"do_lower_case": false,
	"eos_token": "</s>",
	"pad_token": "[PAD]",
	"replace_word_delimiter_char": " ",
	"tokenizer_class": "Wav2Vec2CTCTokenizer",
	"unk_token": "[UNK]",
	"word_delimiter_token": "\|"
	}