Need to change prompt template or RAG is not working
#5
by
Afamocc
- opened
Hi, I see that the model generates this hash file in the blobs ollama forlder when imported:
{{ if .System }}<|system|>
{{ .System }}<|end|>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>
However, using this model with RAG knowledge in openwebui does not work: the model is not aware of the context.
If I cange it to:
user
{{ if .System }}{{ .System }} {{ end }}{{ .Prompt }}
model
{{ .Response }}
It is RAG context aware, but send endless response. Why is this?