IHaBiS commited on
Commit
ff9347a
1 Parent(s): 986ad6d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -11,6 +11,19 @@ pipeline_tag: text-generation
11
  tags:
12
  - not-for-all-audiences
13
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
  # PiVoT-0.1-early
16
 
 
11
  tags:
12
  - not-for-all-audiences
13
  ---
14
+ ## Exl2 version of [maywell/PiVoT-0.1-Evil-a](https://huggingface.co/maywell/PiVoT-0.1-Evil-a)
15
+
16
+ ## branch
17
+ main : 8bpw h8
18
+ 6bh8 : 6bpw h8
19
+ 4bh8 : 4bpw h8
20
+
21
+ Using [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer) as dataset
22
+
23
+ Quantization settings : ```python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp -cf PiVoT-0.1-Evil-a-8bpw-h8-exl2 -c 0000.parquet -l 4096 -b 8 -hb 8```
24
+ ```python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp2 -cf PiVoT-0.1-Evil-a-6bpw-h8-exl2 -c 0000.parquet -l 4096 -b 6 -hb 8 -m PiVoT-0.1-Evil-a-temp/measurement.json```
25
+ ```python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp3 -cf PiVoT-0.1-Evil-a-4bpw-h8-exl2 -c 0000.parquet -l 4096 -b 4 -hb 8 -m PiVoT-0.1-Evil-a-temp/measurement.json```
26
+ ### below this line is original readme
27
 
28
  # PiVoT-0.1-early
29