FantasiaFoundry commited on
Commit
08c544d
1 Parent(s): 1274c18

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
4
- Simple python script (`gguf-imat.py`) to generate various GGUF-Imatrix quantizations from a Hugging Face `author/model` input, for Windows and NVIDIA hardware.
5
 
6
  This is setup for a Windows machine with 8GB of VRAM, assuming use with an NVIDIA GPU. If you want to change the the `-ngl` (number of GPU layers) amount, you can do so at **line 120**. This is only relevant during the `--imatrix` data generation. If you don't have enough VRAM you can decrease the `-ngl` amount or set it to 0 to only use your System RAM instead for all layers.
7
 
@@ -18,5 +18,4 @@ Adjust `quantization_options` in **line 133**.
18
  python .\gguf-imat.py
19
  ```
20
  <br><br>
21
-
22
  **If this proves useful for you, feel free to credit and share the repository.**
 
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
4
+ Simple python script (`gguf-imat.py`) to generate various GGUF-IQ-Imatrix quantizations from a Hugging Face `author/model` input, for Windows and NVIDIA hardware.
5
 
6
  This is setup for a Windows machine with 8GB of VRAM, assuming use with an NVIDIA GPU. If you want to change the the `-ngl` (number of GPU layers) amount, you can do so at **line 120**. This is only relevant during the `--imatrix` data generation. If you don't have enough VRAM you can decrease the `-ngl` amount or set it to 0 to only use your System RAM instead for all layers.
7
 
 
18
  python .\gguf-imat.py
19
  ```
20
  <br><br>
 
21
  **If this proves useful for you, feel free to credit and share the repository.**