Hugging Face's logo

mlc-ai
/
Qwen2-7B-Instruct-q4f16_1-MLC

MLC-LLM
web-llm
Model card Files Community
1

Got garbled Chinese characters

#1
by conun - opened
Discussion
conun
  1. Example:
    e.g. payload = {
    "messages": [
    {"role": "user", "content": "青椒肉丝的做法"},
    ],
    }
    garbled result snippets:
  • �粉：适量（用于腌肉）
  • �：少许（增加鲜味）
  • �精或鸡粉（可选）：适量
  1. also got garbled Chinese characters when using q0f16
  2. It's ok when do inference with vllm + origin Qwen2-7B-Instruct

Sign up or log in to comment