Update config.json
#3
by
huseink
- opened
Update the eos_token_id to 128009, replacing the previous value, to address output generation issues with Llama3 instruct, in accordance with updates from the official Meta LLama3 Instruct repository (see https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/discussions/105).
From <|end_of_text|> to <|eot_id|>
danielhanchen
changed pull request status to
merged
@huseink Thanks! Would you be interested in updating llama-70b as well :)
@danielhanchen sure thing :)