Upload README.md with huggingface_hub

README.md

@@ -14,7 +14,6 @@ tags:
 - imat
 - imatrix
 - static
-- 8bit
 - 6bit
 - 5bit
 - 4bit
@@ -55,7 +54,6 @@ Link: [here](https://huggingface.co/legraphista/DeepSeek-Coder-V2-Instruct-IMat-
 ### Common Quants
 | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
 | -------- | ---------- | --------- | ------ | ------------ | -------- |
-| DeepSeek-Coder-V2-Instruct.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
 | DeepSeek-Coder-V2-Instruct.Q6_K | Q6_K | - | ⏳ Processing | ⚪ Static | -
 | DeepSeek-Coder-V2-Instruct.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
 | DeepSeek-Coder-V2-Instruct.Q3_K | Q3_K | - | ⏳ Processing | 🟢 IMatrix | -
@@ -65,7 +63,6 @@ Link: [here](https://huggingface.co/legraphista/DeepSeek-Coder-V2-Instruct-IMat-
 ### All Quants
 | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
 | -------- | ---------- | --------- | ------ | ------------ | -------- |
-| DeepSeek-Coder-V2-Instruct.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
 | DeepSeek-Coder-V2-Instruct.Q6_K | Q6_K | - | ⏳ Processing | ⚪ Static | -
 | DeepSeek-Coder-V2-Instruct.Q5_K | Q5_K | - | ⏳ Processing | ⚪ Static | -
 | DeepSeek-Coder-V2-Instruct.Q5_K_S | Q5_K_S | - | ⏳ Processing | ⚪ Static | -
@@ -97,11 +94,11 @@ pip install -U "huggingface_hub[cli]"
 ```
 Download the specific file you want:
 ```
-huggingface-cli download legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF --include "DeepSeek-Coder-V2-Instruct.Q8_0.gguf" --local-dir ./
+huggingface-cli download legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF --include "DeepSeek-Coder-V2-Instruct.Q6_K.gguf" --local-dir ./
 ```
 If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run:
 ```
-huggingface-cli download legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF --include "DeepSeek-Coder-V2-Instruct.Q8_0/*" --local-dir ./
+huggingface-cli download legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF --include "DeepSeek-Coder-V2-Instruct.Q6_K/*" --local-dir ./
 # see FAQ for merging GGUF's
 ```
 
@@ -131,7 +128,7 @@ Assistant: {assistant_response}<｜end▁of▁sentence｜>User: {next_user_promp
 
 ### Llama.cpp
 ```
-llama.cpp/main -m DeepSeek-Coder-V2-Instruct.Q8_0.gguf --color -i -p "prompt here (according to the chat template)"
+llama.cpp/main -m DeepSeek-Coder-V2-Instruct.Q6_K.gguf --color -i -p "prompt here (according to the chat template)"
 ```
 
 ---
@@ -146,8 +143,8 @@ According to [this investigation](https://www.reddit.com/r/LocalLLaMA/comments/1
     - To get hold of `gguf-split`, navigate to https://github.com/ggerganov/llama.cpp/releases
     - Download the appropriate zip for your system from the latest release
     - Unzip the archive and you should be able to find `gguf-split`
-2. Locate your GGUF chunks folder (ex: `DeepSeek-Coder-V2-Instruct.Q8_0`)
-3. Run `gguf-split --merge DeepSeek-Coder-V2-Instruct.Q8_0/DeepSeek-Coder-V2-Instruct.Q8_0-00001-of-XXXXX.gguf DeepSeek-Coder-V2-Instruct.Q8_0.gguf`
+2. Locate your GGUF chunks folder (ex: `DeepSeek-Coder-V2-Instruct.Q6_K`)
+3. Run `gguf-split --merge DeepSeek-Coder-V2-Instruct.Q6_K/DeepSeek-Coder-V2-Instruct.Q6_K-00001-of-XXXXX.gguf DeepSeek-Coder-V2-Instruct.Q6_K.gguf`
     - Make sure to point `gguf-split` to the first chunk of the split.
 
 ---