Create README.md

README.md

@@ -0,0 +1,20 @@
+---
+language: en
+license: other
+commercial: no
+inference: false
+---
+# pygmalion-13b-4bit-128g
+## Model description
+**Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.**
+
+Quantized from the decoded pygmalion-13b xor format.
+**https://huggingface.co/PygmalionAI/pygmalion-13b**
+
+In safetensor format.
+
+### Quantization Information
+GPTQ CUDA quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
+```
+python llama.py --wbits 4 models/pygmalion-13b c4 --true-sequential --groupsize 128 --save_safetensors models/pygmalion-13b/4bit-128g.safetensors
+```