ArthurZ HF staff sanchit-gandhi HF staff commited on
Commit
5ab69db
1 Parent(s): f8fb469

Allow single quotes "'" and hyphens "-" (#3)

Browse files

- Allow single quotes "'" and hyphens "-" (a5796832d706e2ccafe86bdf823d50b75b4a6b2c)


Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +0 -2
config.json CHANGED
@@ -50,12 +50,10 @@
50
  "suppress_tokens": [
51
  1,
52
  2,
53
- 6,
54
  7,
55
  8,
56
  9,
57
  10,
58
- 12,
59
  14,
60
  25,
61
  26,
 
50
  "suppress_tokens": [
51
  1,
52
  2,
 
53
  7,
54
  8,
55
  9,
56
  10,
 
57
  14,
58
  25,
59
  26,