Spaces:

RobertSinclair

/

README

like 1

Running

I created a google colab notebook.
It downloads the model, quantize it, check it and upload it.

Cool. Could you link it?

Also, just to make sure I understand, you claim q6_k created using your method would have less degraded output quality than the typical q6_k, same goes for q5_k, etc...?

Thanks

Cool. Could you link it?

No need: here is how to do it: https://huggingface.co/spaces/RobertSinclair/README

Also, just to make sure I understand, you claim q6_k created using your method would have less degraded output quality than the typical q6_k, same goes for q5_k, etc...?

Thanks

Yes.