dolly-v2-7b-sharded-8bit / generation_config.json
pszemraj's picture
add early_stopping and do_sample
e5f3fba
raw
history blame
276 Bytes
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": 0,
"transformers_version": "4.28.1",
"use_cache": false,
"early_stopping": true,
"do_sample": true,
"temperature": 0.1,
"top_p": 0.75,
"top_k": 40,
"num_beams": 4,
"max_new_tokens": 128
}