Prompt Format and System Prompt/Pre-Prompt
Congrats for your model.
Can you provide Prompt format and system prompt/pre-prompt example, also suggested inference parameters, as i can't force the model to answer in Bahasa Indonesia. All question is answered in English. Trying to do question in Vietnamese, the model answer in english. Do question in english, model give wrong answer (hallucinate).
for additional information, i use the model in GGUF format (FP16).
Tried the 4B model, the model can answer in Bahasa Indonesia (as i know that Qwen1.5-4B can also do this), but it's give wrong answer (hallucinate) for just simple question (not country specific question).
@gmonsoon Thanks for your interest! The model is just a base model and it should be strong in in-context learning but not instruction following. We will release a chat model and its gguf version in 1~2 days. The chat model can follow instructions better. Please stay tuned!
@gmonsoon Hello, we have released https://huggingface.co/sail/Sailor-0.5B-Chat . Feel free to give it a try!