Safetensors
English
falcon_mamba
4-bit precision
bitsandbytes
falcon-mamba-7b-instruct-4bit / generation_config.json
Gkunsch's picture
Update generation_config.json
ac7bbc1 verified
raw
history blame contribute delete
156 Bytes
{
"_from_model_config": true,
"bos_token_id": 8,
"eos_token_id": [
11,
10
],
"pad_token_id": 0,
"transformers_version": "4.45.0.dev0"
}