Aya as a translation tool?
Has anyone done any testing on Aya as a translation tool? Particularly for English<->X pairs.
Performance looks pretty terrible in my use case. Sometimes, it does not even understand the task. For example, instead of translation, it may do text completion in the target language, or just repeat the text in the original language.
Appreciate you sharing the feedback and sorry about your experience @actuaryzhang ! Which languages did you try it out for?
Aya-101 was actually an experiment in breadth & our aim was to provide coverage for as many languages as possible (101).
It's widely known that models attempting to serve such a large no. of languages often lag in performance because of the need to share model capacity so widely (aka curse of multilinguality).
This is why we developed Aya 23 models. Would recommend checking these out.
Thanks for your reply
@shivi
I tried English to Portuguese and English to Danish.
See the examples below.
