Hugging Face's logo

google
/
gemma-4-12B-it

Any-to-Any
Transformers
Safetensors
gemma4_unified
image-text-to-text
Eval Results
Model card Files
xet
 Community
39

it is speaking Cantonese while user prompt is Simplified Chinese

#24
by leiyang88 - opened
Discussion
leiyang88
•
edited 3 days ago

I tried both 26b a4b and 31b, working fine.
but 12b is speaking Cantonese.
this is just annoying.

---update---
the 6th Jun updated gguf by unsloth fixed this issue.
so this might be issue of gguf, not the original model.
thnamratha
 Google org

Hi @leiyang88 ,

Thanks for addressing the issue!
To help us investigate and reproduce this exactly, could you please share:

  1. The exact prompt you used.
  2. A screenshots of the unexpected output if possible.
J22

I think all prompts (as simple as 你好) in simplified Chinese can trigger Cantonese response.
leiyang88
•
edited 5 days ago

Hi @leiyang88 ,

Thanks for addressing the issue!
To help us investigate and reproduce this exactly, could you please share:

  1. The exact prompt you used.
  2. A screenshots of the unexpected output if possible.

I used https://modelscope.cn/models/unsloth/gemma-4-12b-it-GGUF gemma-4-12b-it-UD-Q8_K_XL.gguf usign llama.server latest version. default parameters.
windows 11, cuda 13 rtx 3090 24G.

Sign up or log in to comment