Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,6 @@ language:
|
|
4 |
author: froggeric (https://huggingface.co/datasets/froggeric/imatrix/edit/main/README.md)
|
5 |
---
|
6 |
# All credit for this wonderful Repo Card detailing and explaining the similarities and differences of computed imatrices and detailing and explaining the differences, similarities, and, highlighted significances of training datasets and their purported purposes for particular large language models, goes to froggeric.
|
7 |
-
# Input files for generating the Importance Matrix
|
8 |
|
9 |
# Note: All uploaded imatrices to this repo are pre-computed, and are, therefore, ready to be used in llama.cpp's quantization process.
|
10 |
|
@@ -15,6 +14,8 @@ author: froggeric (https://huggingface.co/datasets/froggeric/imatrix/edit/main/R
|
|
15 |
llama.cpp % ./quantize --imatrix path_to_imatrix path_to_model/ggml-model-f16.gguf model_name-QuantType.gguf QuantType
|
16 |
```
|
17 |
|
|
|
|
|
18 |
## Which file to use for generating the importance matrix
|
19 |
|
20 |
Not all importance matrices are equal. The best results are obtained when using a source file similar to the
|
|
|
4 |
author: froggeric (https://huggingface.co/datasets/froggeric/imatrix/edit/main/README.md)
|
5 |
---
|
6 |
# All credit for this wonderful Repo Card detailing and explaining the similarities and differences of computed imatrices and detailing and explaining the differences, similarities, and, highlighted significances of training datasets and their purported purposes for particular large language models, goes to froggeric.
|
|
|
7 |
|
8 |
# Note: All uploaded imatrices to this repo are pre-computed, and are, therefore, ready to be used in llama.cpp's quantization process.
|
9 |
|
|
|
14 |
llama.cpp % ./quantize --imatrix path_to_imatrix path_to_model/ggml-model-f16.gguf model_name-QuantType.gguf QuantType
|
15 |
```
|
16 |
|
17 |
+
# Input files for generating the Importance Matrix
|
18 |
+
|
19 |
## Which file to use for generating the importance matrix
|
20 |
|
21 |
Not all importance matrices are equal. The best results are obtained when using a source file similar to the
|