Best model for its size, people are not using due to absense of GGUFs.
#12
by Sourajit123 - opened
Can there be official GGUFs for the model? Thats the only reason hardly anyone is using this great of a model
Can there be official GGUFs for the model? Thats the only reason hardly anyone is using this great of a model
You can always use llama.cpp yourself for conversion https://www.geeksforgeeks.org/machine-learning/how-to-convert-a-huggingface-model-to-gguf-file-format/
I know I can convert. But most users don't convert themselves- nor is it that high quality. Bartowski is also great, but unsloth is just more popular. I feel either unsloth should make the quants or Ling team should publish official ones just to increase publicity. The model deserves it- its literally the best in its size class