Update README.md
Browse files
README.md
CHANGED
@@ -3,7 +3,10 @@ metrics: null
|
|
3 |
---
|
4 |
|
5 |
Quantized Meta AI's [LLaMA](https://arxiv.org/abs/2302.13971) in 4bit with the help of [GPTQ](https://arxiv.org/abs/2210.17323v2) algorithm v2.
|
6 |
-
|
|
|
|
|
|
|
7 |
|
8 |
Conversion process
|
9 |
```sh
|
|
|
3 |
---
|
4 |
|
5 |
Quantized Meta AI's [LLaMA](https://arxiv.org/abs/2302.13971) in 4bit with the help of [GPTQ](https://arxiv.org/abs/2210.17323v2) algorithm v2.
|
6 |
+
|
7 |
+
GPTQ implementation - https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/841feedde876785bc8022ca48fd9c3ff626587e2
|
8 |
+
|
9 |
+
**Note:** This model will fail to load with current GPTQ-for-LLaMa implementation
|
10 |
|
11 |
Conversion process
|
12 |
```sh
|