File size: 189 Bytes
defbf8b
 
 
 
f05b095
bb1eb55
defbf8b
bb1eb55
defbf8b
bb1eb55
defbf8b
bb1eb55
defbf8b
bb1eb55
defbf8b
bb1eb55
f5501ad
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---
license: llama3
---

Quantized with these parameters:

--bits 4 

--group_size 128 

--desc_act 1 

--damp 0.1  

--seqlen 16384 

--num_samples 512

Quantization Dataset: Erotiquant XL