Quantization support
#1
by
LittenBuzz
- opened
Hi
Thanks for your awesome work on this project
Can you please kindly consider quantizing this model to GPTQ ?
Sorry, but I am not sure how that is done.
vibhorag101
changed discussion status to
closed