TheBloke commited on
Commit
7c728ee
1 Parent(s): 3028be5

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -77,7 +77,7 @@ Multiple quantisation parameters are provided, to allow you to choose the best o
77
 
78
  Each separate quant is in a different branch. See below for instructions on fetching from different branches.
79
 
80
- All GPTQ files are made with AutoGPTQ.
81
 
82
  <details>
83
  <summary>Explanation of GPTQ parameters</summary>
@@ -128,7 +128,7 @@ It is strongly recommended to use the text-generation-webui one-click-installers
128
  6. In the **Model** dropdown, choose the model you just downloaded: `OpenBuddy-Llama2-13B-v11.1-GPTQ`
129
  7. The model will automatically load, and is now ready for use!
130
  8. If you want any custom settings, set them and then click **Save settings for this model** followed by **Reload the Model** in the top right.
131
- * Note that you do not need to set GPTQ parameters any more. These are set automatically from the file `quantize_config.json`.
132
  9. Once you're ready, click the **Text Generation tab** and enter a prompt to get started!
133
  <!-- README_GPTQ.md-text-generation-webui end -->
134
 
 
77
 
78
  Each separate quant is in a different branch. See below for instructions on fetching from different branches.
79
 
80
+ All recent GPTQ files are made with AutoGPTQ, and all files in non-main branches are made with AutoGPTQ. Files in the `main` branch which were uploaded before August 2023 were made with GPTQ-for-LLaMa.
81
 
82
  <details>
83
  <summary>Explanation of GPTQ parameters</summary>
 
128
  6. In the **Model** dropdown, choose the model you just downloaded: `OpenBuddy-Llama2-13B-v11.1-GPTQ`
129
  7. The model will automatically load, and is now ready for use!
130
  8. If you want any custom settings, set them and then click **Save settings for this model** followed by **Reload the Model** in the top right.
131
+ * Note that you do not need to and should not set manual GPTQ parameters any more. These are set automatically from the file `quantize_config.json`.
132
  9. Once you're ready, click the **Text Generation tab** and enter a prompt to get started!
133
  <!-- README_GPTQ.md-text-generation-webui end -->
134