Best way to apply to some specific language?

#4
by minhbui - opened

Hi, first of all, thanks for contribute good model to the community. I want to ask for some recommendation or some suggestion about apply or continue finetune or pretrain this on specific language such as vietnamese,...Which is the best way to improve the quality? Thanks

One idea I think could work, but haven't tried yet, is to modify the prompt. The default prompt can be found here: https://huggingface.co/Alibaba-NLP/gte-Qwen2-1.5B-instruct/blob/main/config_sentence_transformers.json. You could for instance edit this into: "Instruct: Given a Vietnamese web search query, retrieve relevant Vietnamese passages that answer the query\nQuery: "

Thanks, i will try it.

minhbui changed discussion status to closed

Sign up or log in to comment