Ancestral commited on
Commit
36f89a1
1 Parent(s): 5d888b0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -1,3 +1,21 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ tags:
4
+ - text generation
5
+ - conversational
6
+ - gptq
7
+ - 4bit
8
+ inference: false
9
+ language:
10
+ - en
11
+ pipeline_tag: text-generation
12
  ---
13
+
14
+ GPTQ quantization of https://huggingface.co/TehVenom/Dolly_Shygmalion-6b
15
+
16
+ Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2
17
+
18
+ Command:
19
+ ```
20
+ python3 gptj.py models/Dolly_Shygmalion-6b c4 --wbits 4 --groupsize 128 --save_safetensors models/Dolly_Shygmalion-6b-4bit-128g.safetensors
21
+ ```