Update README.md
Browse files
README.md
CHANGED
@@ -39,7 +39,7 @@ In the `main` branch you will find `Guanaco-65B-GPTQ-4bit.act-order.safetensors`
|
|
39 |
|
40 |
This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility.
|
41 |
|
42 |
-
It was created without groupsize to minimise VRAM requirements
|
43 |
|
44 |
* `Guanaco-65B-GPTQ-4bit.act-order.safetensors`
|
45 |
* Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
|
|
|
39 |
|
40 |
This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility.
|
41 |
|
42 |
+
It was created without groupsize to minimise VRAM requirements. It was created with the `--act-order` parameter to maximise accuracy.
|
43 |
|
44 |
* `Guanaco-65B-GPTQ-4bit.act-order.safetensors`
|
45 |
* Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
|