01-ai

/

Yi-34B

like 1.28k

@cizhenshi it won’t perform super well for a chat model as it’s only a base model. If you want to chat with it, use the yi chat or nous capybara yi34b or dolphin yi 34b

Hi, @cizhenshi

1. Check the model name, should be chat model which download from: https://huggingface.co/01-ai/Yi-34B-Chat
2. Use the chat template(ChatML) may help, you can found example scripts here: https://github.com/01-ai/Yi#31-use-the-chat-model

Hi, @cizhenshi

1. Check the model name, should be chat model which download from: https://huggingface.co/01-ai/Yi-34B-Chat
2. Use the chat template(ChatML) may help, you can found example scripts here: https://github.com/01-ai/Yi#31-use-the-chat-model

I use the same code with 2. , but got different result "Hello! How can I assist you today? If you have any questions or need information on a specific topic, feel free to ask."

Hi, @cizhenshi

1. Check the model name, should be chat model which download from: https://huggingface.co/01-ai/Yi-34B-Chat
2. Use the chat template(ChatML) may help, you can found example scripts here: https://github.com/01-ai/Yi#31-use-the-chat-model

I use the same code with 2. , but got different result "Hello! How can I assist you today? If you have any questions or need information on a specific topic, feel free to ask."

This is as expected; the model's responses have a certain degree of uncertainty.