TheBloke commited on
Commit
cfd3a3f
1 Parent(s): d375338

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -68,7 +68,15 @@ And after it, add:
68
  pip install einops
69
  ```
70
 
71
- 4. Then launch text-generation-webui as described below
 
 
 
 
 
 
 
 
72
 
73
  ## How to download and use this model in text-generation-webui
74
 
 
68
  pip install einops
69
  ```
70
 
71
+ 4. Install the latest AutoGPTQ and compile from source - note that this requires compiling the CUDA kernel, which requires CUDA toolkit. This may be an issue for Windows users.
72
+
73
+ ```
74
+ git clone https://github.com/PanQiWei/AutoGPTQ
75
+ cd AutoGPTQ
76
+ pip install . # This step requires CUDA toolkit installed
77
+ ```
78
+
79
+ 5. Then launch text-generation-webui as described below
80
 
81
  ## How to download and use this model in text-generation-webui
82