pszemraj patrickvonplaten commited on
Commit
c4d485b
1 Parent(s): efb9885

Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 (#2)

Browse files

- Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 (25379df8a7192412b2facb108823c1f3b5c4b6d5)


Co-authored-by: Patrick von Platen <patrickvonplaten@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -6,7 +6,7 @@
6
  "OPTForCausalLM"
7
  ],
8
  "attention_dropout": 0.0,
9
- "bos_token_id": 0,
10
  "do_layer_norm_before": false,
11
  "dropout": 0.1,
12
  "eos_token_id": 2,
 
6
  "OPTForCausalLM"
7
  ],
8
  "attention_dropout": 0.0,
9
+ "bos_token_id": 2,
10
  "do_layer_norm_before": false,
11
  "dropout": 0.1,
12
  "eos_token_id": 2,