AlekseyKorshuk patrickvonplaten commited on
Commit
cd1d4cf
1 Parent(s): bb64af6

Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 (#1)

Browse files

- Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 (41ca8fb3b9b0d29d80471a9853e2f710e0fb694d)


Co-authored-by: Patrick von Platen <patrickvonplaten@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -7,7 +7,7 @@
7
  ],
8
  "attention_dropout": 0.0,
9
  "attn_pdrop": 0.1,
10
- "bos_token_id": 50256,
11
  "classifier_dropout": 0.0,
12
  "d_model": 1024,
13
  "decoder_attention_heads": 16,
 
7
  ],
8
  "attention_dropout": 0.0,
9
  "attn_pdrop": 0.1,
10
+ "bos_token_id": 2,
11
  "classifier_dropout": 0.0,
12
  "d_model": 1024,
13
  "decoder_attention_heads": 16,