jais quantization
#1
by
Jmyuse
- opened
Great job! And how did you quantize the jais to 4-bit?
Hey thanks! I hope that it's working with you.
I used BitsandBytes on a 24GB A5000 GPU.
Great job! And how did you quantize the jais to 4-bit?
Hey thanks! I hope that it's working with you.
I used BitsandBytes on a 24GB A5000 GPU.