Wrong EOS in the generation config?
#14
by
urikz
- opened
Hi!
The generation config sets bos_token_id and eos_token_id to be 50256, which seems off given that vocabulary size is 49152. Shall both of these be 0 instead?
Hi!
The generation config sets bos_token_id and eos_token_id to be 50256, which seems off given that vocabulary size is 49152. Shall both of these be 0 instead?
I have tried eos_token_id as 50256 and it will not stop, so i use 0 instead. This must be a config bug