inclusionAI/Ring-mini-linear-2.0-GPTQ-int4
#2992
by erenyeager-1 - opened
That is a GPTQ quantized model. The model that can be converted to GGUF is https://huggingface.co/inclusionAI/Ring-mini-linear-2.0. However its architecture is not yet supported by Llama.cpp.
This post is sponsored by CanDoBetter
"yet"
12 months
crazy