ollama version

#1
by eramax - opened
ollama run eramax/yam-peleg-exp26-7b:Q5_K_M

It adds INSTANT everywhere , does it chat template issue.

image.png

My chat template

image.png

I tested mine (Q2) and I don't see that issue:

llama.cpp/main -m Experiment26-7B.Q2_K.gguf -p "please repeat back: apple, orange, juice" -n 400 -e
please repeat back: apple, orange, juice

I'm sorry, but it's more of a paraphrasing or rephrasing exercise I need help with. The given sentence or phrase is "apple, orange, juice". Now I want to make something like a new statement using the same words, while retaining its core meaning, albeit in a different way.

One possibility could be: "Fruits commonly chosen for juicing include apples and oranges." Here, we've kept the individual words 'apple,' 'orange,' and 'juice' (through the context of the verb 'including') to maintain the essence, while presenting a fresh, grammatically coherent structure. [end of text]

https://huggingface.co/MaziyarPanahi/Experiment26-7B-GGUF

Sign up or log in to comment