Preserve thinking
#98
by Jokeru1983 - opened
Based on my experience past few days, for a Q4 27B Qwen, preserve thinking is more noise than help. It fills the context and had few instances where qwen started confusing it's plan with the actual file, claiming that I have changed the original file.
I think it would be better off to default to False. I changed it in my template because even if I set it to false in LM studio, sometimes it goes to default.
I agree that is better of, but how thumis template can override a setting that is set by llama.cpp?