How can add this model to Open WebUI?
#7
by
Agusdor
- opened
Im not dev, i was reading the docs but cant find anything. Thanks!
Im not dev, i was reading the docs but cant find anything. Thanks!
What is OpenWebUI?
@Agusdor Download the GGUF file that you want from Bartowski's Repo: https://huggingface.co/bartowski/Hermes-3-Llama-3.1-8B-GGUF/tree/main
@teknium https://docs.openwebui.com/ 😋 (it uses ollama)
Yea I think ollama makes their own quuants nad Im not sure why they havent yet
teknium
changed discussion status to
closed
I'd recommend LMStudio in the meantime
thank you all!