Prompt Format and System Prompt/Pre-Prompt

#1
by gmonsoon - opened

Congrats for your model.

Can you provide Prompt format and system prompt/pre-prompt example, also suggested inference parameters, as i can't force the model to answer in Bahasa Indonesia. All question is answered in English. Trying to do question in Vietnamese, the model answer in english. Do question in english, model give wrong answer (hallucinate).

for additional information, i use the model in GGUF format (FP16).

Tried the 4B model, the model can answer in Bahasa Indonesia (as i know that Qwen1.5-4B can also do this), but it's give wrong answer (hallucinate) for just simple question (not country specific question).

image.png

Sea AI Lab org

@gmonsoon Thanks for your interest! The model is just a base model and it should be strong in in-context learning but not instruction following. We will release a chat model and its gguf version in 1~2 days. The chat model can follow instructions better. Please stay tuned!

Sea AI Lab org
edited Mar 5

@gmonsoon Hello, we have released https://huggingface.co/sail/Sailor-0.5B-Chat . Feel free to give it a try!

Sign up or log in to comment