GPTQ quantized version
#3
by
maharshipandya
- opened
Are there any plans to release the GPTQ quantized version of this model?
We will attempt to implement a quantitative model, possibly within the next few weeks. Prior to this, we suggest trying out the interface we have hosted on Hugging Face Space(https://huggingface.co/spaces/m-a-p/ChatMusician).