Hi!
#1
by
Cerarslan
- opened
Hello, I can't understand what these models serve exactly. I tried with 'Searge LLM Node' in ComfyUI but it didn't work. Could you please explain a little bit if you don't mind and if it won't take too much of your time?
You need a program that supports gguf files (which searge llm node might or might not do, I have no clue). You cna use llama.cpp, koboldcpp (simple to use), ollama or many others.
mradermacher
changed discussion status to
closed