ArthurZ HF staff sanchit-gandhi HF staff commited on
Commit
b8d7ffd
1 Parent(s): 407a3a8

Allow single quotes "'" and hyphens "-" (#4)

Browse files

- Allow single quotes "'" and hyphens "-" (54f836ce498930b225ff2a6db8c2a40bddece9f8)


Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +0 -2
config.json CHANGED
@@ -42,12 +42,10 @@
42
  "suppress_tokens": [
43
  1,
44
  2,
45
- 6,
46
  7,
47
  8,
48
  9,
49
  10,
50
- 12,
51
  14,
52
  25,
53
  26,
 
42
  "suppress_tokens": [
43
  1,
44
  2,
 
45
  7,
46
  8,
47
  9,
48
  10,
 
49
  14,
50
  25,
51
  26,