mayaeary commited on
Commit
17e0d49
1 Parent(s): 7323560

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -1,3 +1,21 @@
1
  ---
2
  license: unknown
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: unknown
3
+ tags:
4
+ - text generation
5
+ - conversational
6
+ - gptq
7
+ - 4bit
8
+ inference: false
9
+ language:
10
+ - en
11
+ pipeline_tag: text-generation
12
  ---
13
+
14
+ GPTQ quantization of https://huggingface.co/TehVenom/PPO_Pygway-V8p4_Dev-6b
15
+
16
+ Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2
17
+
18
+ Command:
19
+ ```
20
+ python3 gptj.py models/PPO_Pygway-V8p4_Dev-6b c4 --wbits 4 --groupsize 128 --save_safetensors models/PPO_Pygway-V8p4_Dev-6b-4bit-128g.safetensors
21
+ ```