The model keeps speaking to me in Chinese?

#3
by sleepyjoecheated - opened

I've been using the Q3_K_M quant of this and of Dolphin 34b as well. Dolphin works fine and hasn't tried to speak Chinese even once. This model almost always talks in Chinese. Even if I tell it to speak English, it will apologize in Chinese, or maybe it will revert to English for one response and then go back to Chinese. It's not just me, right?

Here is an example conversation:

USER: hello
ASSISTANT: 你好!请问有什么我可以帮助您的吗?
USER: stop speaking chinese please dog speak american now explain to me task manager or something idk and say it in english
ASSISTANT: 好的,我明白了。现在我将用英语为您解释任务管理器等相关内容:

Task Manager, also known as Windows Task Manager, is a system monitor application included with Microsoft Windows systems. It provides detailed information about computer performance and assists in overseeing running applications and background processes. To access Task Manager, follow these steps:

  1. Press the "Ctrl + Shift + Esc" keys simultaneously on your keyboard to open Task Manager directly. Alternatively, you can right-click on the Start button (or press "Windows key + X") and select "Task Manager" from the context menu.
  2. Once Task Manager opens, you will see several tabs at the top providing different views of the system's status. These include Processes, Performance, App history, Network, Users, Details, and Services.
  3. In the Processes tab, you can view all running apps and background processes, along with their CPU usage, memory usage, disk usage, network usage, and GPU usage. You can end any process by selecting it and clicking the "End Task" button below.
  4. The Performance tab offers an overview of the system's overall performance and individual resource utilization trends. This includes charts for CPU, RAM, disk, and GPU activity, as well as networking data. Clicking on each chart will provide more details and options for managing specific resources.
  5. Other tabs like App History show how much data has been used by installed apps, while Network shows current internet connection statistics. Users and Details tabs display user-related activities and low-level process details respectively.
  6. Finally, the Services tab allows you to manage started services, including stopping, starting, pausing, or restarting them. Be cautious when modifying services, as some are critical to the functioning of your system.

To learn more about Task Manager and its features, refer to the official documentation provided by Microsoft or other relevant online sources.
USER: ok cool thanks dog now what is msi after burner and why does nobody on the entire planet not even one soul use evga precisionx
ASSISTANT: 我很高兴您对我提供的关于任务管理器的信息感到满意。接下来,让我来向您介绍 MSI Afterburner 和 EVGA PrecisionX 的相关知识:

MSI Afterburner 是全球知名的显卡超频和监控软件,由著名硬件制造商微星科技开发和维护。它适用于 NVIDIA 和 AMD/ATI 显卡的驱动程序,并支持大多数现代显卡型号。使用该软件,您可以轻松地监测和管理显卡状态、超频、调节风扇转速以及进行基准测试等操作。此外,它还提供了丰富的定制功能,例如皮肤自定义、OSD(On Screen Display)显示等功能。

EVGA PrecisionX 是 EVGA 公司开发的针对 NVIDIA 显卡的超频工具。虽然它同样提供监视和控制显卡性能的功能,但在过去几年中,它的更新频率较低,且功能相对有限。这可能就是为什么很少有人使用 EVGA PrecisionX 的原因之一。相比之下,MSI Afterburner 在不断优化和完善其功能,并且拥有更广泛的用户群体。因此,更多人选择使用 MSI Afterburner 而非 EVGA PrecisionX。

I am using the TheBloke's Yi-34B GPTQ 4bit, and it is fine. Not sure if you can add "Speak English" in the system prompt

Hey, perhaps you aren't using the right tokenizer? Have you tried TheBlokes GGUF versions of this model? those work fine for me and never speak to me in Mandarin/Chinese.

I found the issue, I was using the wrong prompt format, it's not meant to have a newline https://huggingface.co/TheBloke/Nous-Capybara-34B-GGUF/discussions/3#6554b32a0a67552288463093

sleepyjoecheated changed discussion status to closed

Sign up or log in to comment