Need to change prompt template or RAG is not working

#5
by Afamocc - opened

Hi, I see that the model generates this hash file in the blobs ollama forlder when imported:

{{ if .System }}<|system|>
{{ .System }}<|end|>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>

However, using this model with RAG knowledge in openwebui does not work: the model is not aware of the context.

If I cange it to:

user
{{ if .System }}{{ .System }} {{ end }}{{ .Prompt }}
model
{{ .Response }}

It is RAG context aware, but send endless response. Why is this?

Sign up or log in to comment