Qwable-v2-GGUF could you quant it to q3ks or higher
#2659
by Stickmouse - opened
I've waited days for someone to quant it and nobody has and I can use gguf my repo becouse there's an error each time I use if for mradermacher/Qwable-v2-GGUF
I've waited days for someone to quant it and nobody has and I can use gguf my repo becouse there's an error each time I use if for mradermacher/Qwable-v2-GGUF
That's beacose you cant quant a alredy quanted thing usually
uhm that's weird why it didnt work, I queued it again
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Qwable-v2-GGUF for quants to appear.