|
--- |
|
license: unknown |
|
--- |
|
|
|
- **Bits**: 4 |
|
- **Group Size**: 128 |
|
- **Damp Percent**: 0.01 |
|
- **Desc Act**: false |
|
- **Static Groups**: false |
|
- **Sym**: false |
|
- **True Sequential**: false |
|
- **LM Head**: true |
|
- **Model Name or Path**: null |
|
- **Model File Base Name**: model |
|
- **Quant Method**: gptq |
|
- **Checkpoint Format**: gptq |
|
- **Meta:** |
|
- Quantizer: intel/auto-round:0.1 |
|
- Packer: autogptq:0.8.0.dev1 |
|
- Iters: 400 |
|
- LR: 0.0025 |
|
- MinMax LR: 0.0025 |
|
- Enable MinMax Tuning: true |
|
- Use Quant Input: false |
|
- Scale Dtype: torch.float16 |
