Update README.md
Browse files
README.md
CHANGED
@@ -25,11 +25,11 @@ The chart below presents the calibration perplexity and [wikitext-103-v1](https:
|
|
25 |
|
26 |
| Quant | Calibration Perplexity | wikitext-103-v1 Test Perplexity |
|
27 |
|-----------------------------------------------------------------------------------------|------------------------|---------------------------------|
|
28 |
-
| [2.4bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.4bpw-h6) |
|
29 |
| [2.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.65bpw-h6) | 8.1743 | |
|
30 |
-
| [3.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/3.0bpw-h6) | 7.9927 |
|
31 |
-
| [4.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.0bpw-h6) | 7.6440 |
|
32 |
-
| [4.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.65bpw-h6) | 7.5872 |
|
33 |
| [5.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/5.0bpw-h6) | 7.5745 | |
|
34 |
-
| [6.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/6.0bpw-h6) |
|
35 |
-
| [8.0bpw-h8](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/8.0bpw-h8) |
|
|
|
25 |
|
26 |
| Quant | Calibration Perplexity | wikitext-103-v1 Test Perplexity |
|
27 |
|-----------------------------------------------------------------------------------------|------------------------|---------------------------------|
|
28 |
+
| [2.4bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.4bpw-h6) | 8.4726 | 7.1337 |
|
29 |
| [2.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.65bpw-h6) | 8.1743 | |
|
30 |
+
| [3.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/3.0bpw-h6) | 7.9927 | 6.4607 |
|
31 |
+
| [4.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.0bpw-h6) | 7.6440 | 5.8014 |
|
32 |
+
| [4.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.65bpw-h6) | 7.5872 | 5.7112 |
|
33 |
| [5.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/5.0bpw-h6) | 7.5745 | |
|
34 |
+
| [6.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/6.0bpw-h6) | 7.5616 | |
|
35 |
+
| [8.0bpw-h8](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/8.0bpw-h8) | 7.5604 | |
|