casperhansen

/

mistral-large-instruct-2407-awq

like 3

Hello @casperhansen
Thanks for the quantisation 🙂
Can you please share the script that you used to do it(AWQ quantisation and perplexity)?
And if possible the hardware configuration?!