Quantization support

#1
by LittenBuzz - opened

Hi
Thanks for your awesome work on this project
Can you please kindly consider quantizing this model to GPTQ ?

Sorry, but I am not sure how that is done.

vibhorag101 changed discussion status to closed

Sign up or log in to comment