mayaeary commited on
Commit
167b1ee
1 Parent(s): b6e3fe4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -1,3 +1,21 @@
1
  ---
2
  license: creativeml-openrail-m
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: creativeml-openrail-m
3
+ tags:
4
+ - text generation
5
+ - conversational
6
+ - gptq
7
+ - 4bit
8
+ inference: false
9
+ language:
10
+ - en
11
+ pipeline_tag: text-generation
12
  ---
13
+
14
+ GPTQ quantization of https://huggingface.co/PygmalionAI/pygmalion-6b/commit/30e2405100eac6bd53f75964cc7345eeafd19f7d
15
+
16
+ Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2
17
+
18
+ Command:
19
+ ```
20
+ python3 gptj.py models/pygmalion-6b_dev c4 --wbits 4 --groupsize 128 --save_safetensors models/pygmalion-6b_dev-4bit-128g.safetensors
21
+ ```