snowflake-arctic-instruct / generation_config.json
jeffra's picture
Fixes for GQA support (#14)
314d82d verified
raw
history blame contribute delete
124 Bytes
{
"_from_model_config": true,
"bos_token_id": 31998,
"eos_token_id": 31999,
"transformers_version": "4.40.0.dev0"
}