sanchit-gandhi HF staff commited on
Commit
013fe3b
1 Parent(s): 894f251

add special tokens for fast (#25)

Browse files

- add special tokens for fast (55f5fcdfb66210824046aeee3c5c1028bc364427)

Files changed (3) hide show
  1. tokenizer.json +0 -0
  2. tokenizer_config.json +1 -1
  3. vocab.json +0 -0
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
tokenizer_config.json CHANGED
@@ -19,7 +19,7 @@
19
  "single_word": false
20
  },
21
  "errors": "replace",
22
- "model_max_length": 448,
23
  "pad_token": null,
24
  "processor_class": "WhisperProcessor",
25
  "return_attention_mask": false,
19
  "single_word": false
20
  },
21
  "errors": "replace",
22
+ "model_max_length": 1024,
23
  "pad_token": null,
24
  "processor_class": "WhisperProcessor",
25
  "return_attention_mask": false,
vocab.json CHANGED
The diff for this file is too large to render. See raw diff