"Huihui-Qwen3-4B-Instruct-2507" = garbage outputs, but v2 works
#1
by dummy9996 - opened
Huihui-Qwen3-4B-Instruct-2507 int4 gives garbage outputs (broken)
Sorry. I checked and confirmed that issue. Looks like current text prompt converter model can't convert it. Use the int8 or non-2507 int4 version instead.
dummy9996 changed discussion status to closed