Joseph717171 commited on
Commit
1cc6b00
·
verified ·
1 Parent(s): 431a12c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -4,7 +4,6 @@ language:
4
  author: froggeric (https://huggingface.co/datasets/froggeric/imatrix/edit/main/README.md)
5
  ---
6
  # All credit for this wonderful Repo Card detailing and explaining the similarities and differences of computed imatrices and detailing and explaining the differences, similarities, and, highlighted significances of training datasets and their purported purposes for particular large language models, goes to froggeric.
7
- # Input files for generating the Importance Matrix
8
 
9
  # Note: All uploaded imatrices to this repo are pre-computed, and are, therefore, ready to be used in llama.cpp's quantization process.
10
 
@@ -15,6 +14,8 @@ author: froggeric (https://huggingface.co/datasets/froggeric/imatrix/edit/main/R
15
  llama.cpp % ./quantize --imatrix path_to_imatrix path_to_model/ggml-model-f16.gguf model_name-QuantType.gguf QuantType
16
  ```
17
 
 
 
18
  ## Which file to use for generating the importance matrix
19
 
20
  Not all importance matrices are equal. The best results are obtained when using a source file similar to the
 
4
  author: froggeric (https://huggingface.co/datasets/froggeric/imatrix/edit/main/README.md)
5
  ---
6
  # All credit for this wonderful Repo Card detailing and explaining the similarities and differences of computed imatrices and detailing and explaining the differences, similarities, and, highlighted significances of training datasets and their purported purposes for particular large language models, goes to froggeric.
 
7
 
8
  # Note: All uploaded imatrices to this repo are pre-computed, and are, therefore, ready to be used in llama.cpp's quantization process.
9
 
 
14
  llama.cpp % ./quantize --imatrix path_to_imatrix path_to_model/ggml-model-f16.gguf model_name-QuantType.gguf QuantType
15
  ```
16
 
17
+ # Input files for generating the Importance Matrix
18
+
19
  ## Which file to use for generating the importance matrix
20
 
21
  Not all importance matrices are equal. The best results are obtained when using a source file similar to the