Baichuan2-7B-Chat-MNN / config.json
zhaode's picture
Upload folder using huggingface_hub
2435a4c verified
raw
history blame
189 Bytes
{
"llm_model": "baichuan2-7b-int4.mnn",
"llm_weight": "baichuan2-7b-int4.mnn.weight",
"backend_type": "cpu",
"thread_num": 4,
"precision": "low",
"memory": "low"
}