MetaIX commited on
Commit
2cb1a36
1 Parent(s): aad1998

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -1,12 +1,13 @@
1
- <p><strong>Information</strong></p>
2
- Alpaca 30B 4-bit. It's working with the newest GPTQ. Quantized using --true-sequential and --groupsize 128 optimizations.
 
3
  This was made using Chansung's 30B Alpaca Lora: https://huggingface.co/chansung/alpaca-lora-30b
4
 
5
- <p><strong>Benchmarks</strong></p>
6
- Wikitext2: 4.37
7
 
8
- Ptb: 7.58
9
 
10
- C4: 6.19
11
 
12
- Note: This version uses grouping, therefore evaluations are better. However, this version takes up more VRAM.
 
1
+ <p><strong><font size="5">Information</font></strong></p>
2
+ Alpaca 30B 4-bit working with the newest GPTQ.
3
+ <p>Quantized using <i>--true-sequential</i> and <i>--groupsize 128</i> optimizations.</p>
4
  This was made using Chansung's 30B Alpaca Lora: https://huggingface.co/chansung/alpaca-lora-30b
5
 
6
+ <p><strong><font size="5">Benchmarks</font></strong></p>
7
+ <strong>Wikitext2</strong>: 4.37
8
 
9
+ <strong>Ptb</strong>: 7.58
10
 
11
+ <strong>C4</strong>: 6.19
12
 
13
+ <strong>Note</strong>: This version uses <i>group size 128</i>, therefore evaluations are better. As a result, this version consumes more VRAM.