how to quantize to GGUF quantization

#2
by aswanthachooz - opened

how to quantize to GGUF quantization Because it not supported by Lama.cpp Any other way, someone will find.??

i don't think this model is real, if it was it would be deleted in less than 30 mins by huggingface staff. thats what a huggingface staff told me

ohh i Downloaded that I then i Uninstalled.

May be possible now: https://huggingface.co/QuietImpostor/Gemini-Nano-Safetensors

Probably not as we don't have the source code to Gemini. But hey if there is a will there is a way

May be possible now: https://huggingface.co/QuietImpostor/Gemini-Nano-Safetensors

Probably not as we don't have the source code to Gemini. But hey if there is a will there is a way

If we have a Safetensors what's stopping us from implementing such code ourselves?

May be possible now: https://huggingface.co/QuietImpostor/Gemini-Nano-Safetensors

Probably not as we don't have the source code to Gemini. But hey if there is a will there is a way

If we have a Safetensors what's stopping us from implementing such code ourselves?

That would be very very very hard, I think your underestimating on how hard it would be

Sign up or log in to comment