Updated prompt template
In the course of utilizing this model, the initial output in model generations includes the 'Response' text. It is inferred that the model has undergone training with the ### Assistant Response tag for completion. The proposed modification has been implemented successfully, yielding the intended results.
what is the breed of dog
I actually got this model to give up his training prompt. I won't detail how, but it's the same way as I used for miqu (see: https://huggingface.co/miqudev/miqu-1-70b/discussions/25). Basically using a completely blank template: I first asked about what he saw to do with "###" and then asked if he saw anything before the first "###" and so on...
It turns out why he keeps saying "Response" is because he was training with this:
{System Prompt}
### Instruction:
{Prompt}
### Response:
{Response}
Or using Ollama this template:
TEMPLATE """{{ if and .First .System }}{{ .System }}
{{ end }}### Instruction:
{{ .Prompt }}
### Response:
{{ .Response }}"""
He doesn't seem to have such a huge improvement as miqu got from using the correct prompt but it can't hurt to use the correct format.