| - **bits**: 4 | |
| - **group_size**: 128 | |
| - **desc_act**: true | |
| - **static_groups**: false | |
| - **sym**: true | |
| - **lm_head**: false | |
| - **damp_percent**: 0.01 | |
| - **true_sequential**: true | |
| - **model_name_or_path**: | |
| - **model_file_base_name**: model | |
| - **quant_method**: gptq | |
| - **checkpoint_format**: gptq | |
| - **meta**: | |
| - **quantizer**: gptqmodel:0.9.1 | |