TowerInstruct-7B-v0.1 / generation_config.json
DuarteMRAlves's picture
Update generation config to do greedy decoding by default.
1739212 verified
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": 32005,
"do_sample": false,
"transformers_version": "4.36.2"
}