Hugging Face's logo

Virt-io
/
Google-Colab-Imatrix-GGUF

GGUF
GGUF
Model card Files Community
1
Virt-io commited on
Commit
dbbe441
•
1 Parent(s): dd8d96b

Update Imat_AutoGGUF.ipynb

Browse files
Files changed (1) hide show
  1. Imat_AutoGGUF.ipynb +3 -3
Imat_AutoGGUF.ipynb CHANGED
@@ -33,13 +33,13 @@
33
  "\n",
34
  "# @markdown ### ⚡ Quantization parameters\n",
35
  "MODEL_ID = \"TinyLlama/TinyLlama-1.1B-Chat-v1.0\" # @param {type:\"string\"}\n",
36
- "IMATRIX_OPTION = 'Imatrix' # @param [\"Imatrix\", \"Imatrix-RP\", \"Imatrix-ChatML-test\"]\n",
37
  "if IMATRIX_OPTION == \"Imatrix\":\n",
38
  " IMATRIX = f\"Google-Colab-Imatrix-GGUF/Imatrix/imatrix.txt\"\n",
39
  "if IMATRIX_OPTION == \"Imatrix-RP\":\n",
40
  " IMATRIX = f\"Google-Colab-Imatrix-GGUF/Imatrix/imatrix-with-rp-data.txt\"\n",
41
- "if IMATRIX_OPTION == \"Imatrix-ChatML-test\":\n",
42
- " IMATRIX = f\"Google-Colab-Imatrix-GGUF/Imatrix/chatml_test.txt\"\n",
43
  "print(IMATRIX)\n",
44
  "QUANTIZATION_METHODS = \"IQ4_NL, Q8_0\" # @param {type:\"string\"}\n",
45
  "QUANTIZATION_METHODS = QUANTIZATION_METHODS.replace(\" \", \"\").split(\",\")\n",
 
33
  "\n",
34
  "# @markdown ### ⚡ Quantization parameters\n",
35
  "MODEL_ID = \"TinyLlama/TinyLlama-1.1B-Chat-v1.0\" # @param {type:\"string\"}\n",
36
+ "IMATRIX_OPTION = 'Imatrix' # @param [\"Imatrix\", \"Imatrix-RP\", \"Imatrix-RP-Extended\"]\n",
37
  "if IMATRIX_OPTION == \"Imatrix\":\n",
38
  " IMATRIX = f\"Google-Colab-Imatrix-GGUF/Imatrix/imatrix.txt\"\n",
39
  "if IMATRIX_OPTION == \"Imatrix-RP\":\n",
40
  " IMATRIX = f\"Google-Colab-Imatrix-GGUF/Imatrix/imatrix-with-rp-data.txt\"\n",
41
+ "if IMATRIX_OPTION == \"Imatrix-RP-Extended\":\n",
42
+ " IMATRIX = f\"Google-Colab-Imatrix-GGUF/Imatrix/imatrix-rp-extended.txt\"\n",
43
  "print(IMATRIX)\n",
44
  "QUANTIZATION_METHODS = \"IQ4_NL, Q8_0\" # @param {type:\"string\"}\n",
45
  "QUANTIZATION_METHODS = QUANTIZATION_METHODS.replace(\" \", \"\").split(\",\")\n",