Commit
•
92d0767
1
Parent(s):
a1d02c9
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: other
|
| 3 |
---
|
|
|
|
| 1 |
+
This is a GPTQ 4-bit version of [WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b](https://huggingface.co/Monero/WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b)
|
| 2 |
+
|
| 3 |
+
Quanitized using commit `df77083` of GPTA-for-LLaMa with the following settings:
|
| 4 |
+
```wikitext2 --wbits 4 --true-sequential --act-order --save_safetensors```
|
| 5 |
+
|
| 6 |
+
Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility.
|
| 7 |
+
|
| 8 |
---
|
| 9 |
license: other
|
| 10 |
---
|