notstoic
/

OPT-13B-Erebus-4bit-128g

Text Generation

text-generation-inference

Model card Files Files and versions Community

notstoic commited on Apr 7, 2023

Commit

48ef5a4

•

1 Parent(s): 745907a

Update README.md

Files changed (1) hide show

README.md +4 -3

README.md CHANGED Viewed

@@ -8,14 +8,15 @@ inference: false
 ## Model description
 **Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.**
-This is a 4-bit GPTQ quantization of OPT-13B-Erebus. Original Model: **https://huggingface.co/KoboldAI/OPT-13B-Erebus**
 ### Quantization Information
 Quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
 ```
-python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save models/KoboldAI_OPT-13B-Erebus/4bit-128g.pt
-python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save_safetensors models/KoboldAI_OPT-13B-Erebus/4bit-128g.safetensors
 ```
 ### License

 ## Model description
 **Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.**
+This is a 4-bit GPTQ quantization of OPT-13B-Erebus, original model:
+**https://huggingface.co/KoboldAI/OPT-13B-Erebus**
 ### Quantization Information
 Quantized with: https://github.com/0cc4m/GPTQ-for-LLaMa
 ```
+python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.pt
+python repos/gptq/opt.py --wbits 4 models/KoboldAI_OPT-13B-Erebus c4 --groupsize 128 --save_safetensors models/KoboldAI_OPT-13B-Erebus/OPT-13B-Erebus-4bit-128g.safetensors
 ```
 ### License