Commit
·
18546b8
1
Parent(s):
e5785b9
Added tokenizer from wav2vec2 base model (#1)
Browse files- Added tokenizer from wav2vec2 base model (82fee0caf7340769916963f532efff45a69ecf7a)
Co-authored-by: Ponniah Kameswaran <pokameswaran@users.noreply.huggingface.co>
- tokenizer_config.json +1 -0
tokenizer_config.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"unk_token": "<unk>", "bos_token": "<s>", "eos_token": "</s>", "pad_token": "<pad>", "do_lower_case": false, "return_attention_mask": true, "do_normalize": true}
|