falcon-7b-instruct-gptq / quantize_config.json

Commit History

AutoGPTQ model for tiiuae/falcon-7b-instruct: 4bits, gr128, desc_act=False
d9f1327

mpronesti commited on