aisingapore

/

sea-lion-7b-instruct-research

like 13

Hi thank you very much for your inquiry! If the bahasa that you are referring to is Bahasa Indonesia, we do have some scores for the task of machine translation. We have tested it on the FLoRes-200 dataset in both directions (Indonesian to English & English to Indonesian) and the scores can be found in the model card as well.

The prompts used are as follows:

# For English to Indonesian
Terjemahkan teks berikut ini ke dalam Bahasa Indonesia.\nTeks: {text}\nTerjemahan:  

# For Indonesian to English
Terjemahkan teks berikut ini ke dalam Bahasa Inggris.\nTeks: {text}\nTerjemahan:  

With this Indonesian prompt, sea-lion-7b-instruct-research obtained a ChrF++ score of 52.50 for English to Indonesian and 46.82 for Indonesian to English.

We also have a newer model, sea-lion-7b-instruct, which has an improved ChrF++ score of 57.48 for English to Indonesian and 58.04 for Indonesian to English.

You may also find comparisons with other 7B models in the model card. (Screenshot attached here)

I hope this addresses your question!