Answers without <think> tag
Hi, I'm previously check 32b than this,
in 32b version there is always tag.
But here is missing:
I don't know if base model has it.
@Eryk-Chmielewski Yes, we have also noticed this. It seems to be due to our calibration data, which caused the ‘think’ tag to disappear. We are plan update our calibration data to make it compatible with the think process of the deepseek-r1 series model.
@Eryk-Chmielewski
Are you getting the wrong answers to your logic/math questions without the <think> outputs?
I would say that it behaves more like in CoT prompting.
It does not have that first it tries to understand the question and plan the actions and after finishing think execute them.
It more immediately starts solving the task but as CoT.
But I've noticed other problems too, he can stop halfway through an answer:
Don't answer anythging or answer out of the blue:
@Eryk-Chmielewski Hi, we have fixed the issue with the think tag and released the new Votex V2 version. https://huggingface.co/ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2