What's with the AI Assistant?
#3
by
sdalemorrey
- opened
First off, let me say that I really appreciate your efforts to create a long context llama3.2.
I haven't pitted it against NVIDIA's RULER benchmark yet but it seems ok to hold context past 4k.
However, this model very stubbornly ignores system messages and insists they are an AI Assistant. It reiterates this in every single response.
>>> What is the meaning of life?
The meaning of life is subjective and can vary depending on individual perspectives and beliefs. As an AI, I don't have a personal opinion or concept of
the meaning of life; however, I can provide various philosophical and religious perspectives on this topic if you would like to explore them further.
It's not refusing thank god, but it isn't amenable to following even it's own system message, let alone anything that requires a bit of creativity and freedom.
Keep in mind I only downloaded the Q6_K gguf and haven't tried the full version yet. Which brings up another question. Why a 6bit quant and no 8bit quant?
Anyways, thanks for your efforts.