Update README.md

README.md

@@ -8,6 +8,20 @@ language:
 - ko
 pipeline_tag: text-generation
 ---
+## Exl2 version of [maywell/PiVoT-0.1-early](https://huggingface.co/maywell/PiVoT-0.1-early)  
+
+## branch  
+main : 8bpw h8
+6bh8 : 6bpw h8  
+4bh8 : 4bpw h8  
+
+Using [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer) as dataset  
+ 
+Quantization settings : python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp -cf PiVoT-0.1-Evil-a-8bpw-h8-exl2 -c 0000.parquet -l 4096 -b 8 -hb 8  
+python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp2 -cf PiVoT-0.1-Evil-a-6bpw-h8-exl2 -c 0000.parquet -l 4096 -b 6 -hb 8 -m PiVoT-0.1-Evil-a-temp/measurement.json  
+python convert.py -i models/maywell_PiVoT-0.1-Evil-a -o PiVoT-0.1-Evil-a-temp3 -cf PiVoT-0.1-Evil-a-4bpw-h8-exl2 -c 0000.parquet -l 4096 -b 4 -hb 8 -m PiVoT-0.1-Evil-a-temp/measurement.json  
+
+### below this line is original readme  
 
 # PiVoT-0.1-early