How Can I Try STS task using this model? Can I get some prompt or code pieces for STS task?

#2
by andreaKIM - opened

Hello! Thanks for releasing this model.
Given example codes are expressing retrieval task demonstration.
I would like to apply this model to an STS task, is there an STS prompt that you have utilized for training or STS benchmarks?
I'd be really happy if you could make it public.
Thanks :)

안녕하세요
혹시 이 모델을 STS task에 적용해보고 싶은데 모델 학습 과정이나 benchmark 결과를 얻으실 때 사용하신 적절한 prompt나 코드가 궁금한데 혹시 task별 구체적인 prompt 예시 등을 따로 공개하실 예정이 있으실까요?
감사합니다!

Hi!
We used "Retrieve semantically similar text" in STS task, like E5-Mistral-7B.
For more instructions, You can follow the repo https://github.com/microsoft/unilm/blob/master/e5/utils.py or https://arxiv.org/abs/2401.00368 as we used exactly same instruction with E5-Mistral-7B.

Sign up or log in to comment