Quant pls
#2
by
Yhyu13
- opened
This model has recently rank#1 on the https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Would you like to make quantized versions?
Thanks for pointing it out. TheBloke generally will make quantized formats such as GGUF and AWQ alongside GPTQ. That's why I was invoking him
In the queue