Thank you for quantizing this into GPTQ
#1
by
blindedscience
- opened
This model is REALLY mean. But thanks for taking the time to make sure it was quantized into a few different formats. There's not much GPTQ stuff up at 70B being published anymore.