diag-baichuan2-4bit / generation_config.json
curtis-sun's picture
init
dd4e85d
{
"pad_token_id": 0,
"bos_token_id": 1,
"eos_token_id": 2,
"user_token_id": 195,
"assistant_token_id": 196,
"max_new_tokens": 1000,
"num_beams": 2,
"early_stopping": true,
"transformers_version": "4.32.1"
}