Add eos_token_id to generation config
#26
by
mayank-mishra
- opened
Currently, the model never stops generating because the eos_token_id is None inside HF generate function.
The eos_token_id is inferred from the generation config.
This token id can be passed in explicitely but its better to have it in the config.
@jfrankle can you take a look at this?
sam-mosaic
changed pull request status to
merged