Any recommended frontend to run this model?
#30
by
DrNicefellow
- opened
The frontend is supposed to support using RAG usage with this model.
I believe openwebui (with ollama) supports RAG, some extension on oogabooga may also do the same, but afaik openwebui comes with it standard
I believe openwebui (with ollama) supports RAG, some extension on oogabooga may also do the same, but afaik openwebui comes with it standard
But this model has his peculiar way of prompting RAG, which would probably yield optimal performances.