mpt-7b-storysummarizer / generation_config.json
emozilla's picture
add kv cache
bbaa409
{
"_from_model_config": true,
"transformers_version": "4.29.2",
"eos_token_id": 0,
"use_cache": true
}