llama.cpp supports?
llama.cpp + GGUF supports?
Commenting so I get things in my notifications since huggingface doesn't have way to do that without commenting
+1
+1 For llama.cpp. Thank you for gifting us the model.
Did you ever manage to port support into llama.cpp mainline before? For Ling-2.6-flash took me some trying to get it running
https://huggingface.co/ljupco/Ling-2.6-flash-GGUF
On a llama.cpp branch here
https://github.com/ljubomirj/llama.cpp/tree/LJ-Ling-2.6-flash-r2
Being 'AI-assisted' it's against the llama.cpp policy, so never attempted a PR. Maybe you are knowledgeable enough to do a real PR for Ling-3-Flash for llama.cpp this time around? Excellent sizing, exactly what I needed in between the 30B-A3B class of models and the 280B-A13B like deepsseek, mimo etc. Post training extending context to 1M would be a blast too. But we can do with 256K context at A5M. Thank you.
+1